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SUMMARY 


A model for human decision-makinp, has been developed and 
tested against experimental data. This model is a straightforward 
adaptation of the optimal-control model for pilot/vehicle systems 
developed by Bolt Beranek and Newman Inc. The models for decision 
and control both contain the concepts of time delay , observation 
noise, optimal prediction, and optimal estimation. The model for 
decision-making developed in this study is intended to apply to 
situations in which the human bases his decision on his estimate 
of the state of a linear plant. 

Experiments are described for the following task situations: 
(a) single decision tasks, (b) two decision tasks, and (c) simul- 
taneous manual control and decision-making. Using fixed values 
for model parameters, we can predict single-task and two-task 
decision performance to within an accuracy of 10 percent. Agree- 
ment is less good for the simultaneous decision and control situ- 
ation, and the results of this experiment do not allow a conclu- 
sive test of the predictive capability of the m.odel in this situ- 
ation . 


1. INTRODUCTION 


Considerable effort has been devoted to understanding how a 
pilot controls his aircraft, and reasonably accurate models for 
the pilot as a feedback controller have been developed. Continu- 
ous control, however, is but one of the functions required of 
the pilot; he must also make some crucial decisions during the 
course of a flight. Perhaps most important is the decision 
whether to attempt a landing or to go around for another try . 
Clearly, a miscalculation could have very serious consequences. 

In addition, the pilot must continuously monitor the behavior of 
the aircraft so that he may ascertain whether or not the system 
is behaving properly. Control-^system failures will occur from 
time-to-time , and the pilot must auickly identify such a failure 
and Initiate the appropriate recovery strategy. As flight-control 
systems become more sophisticated, monitoring and decision-making 
tasks will play an increasingly Important role in the pilot's 
management of the aircraft . 

In order that we may have the proper tools for analyzing 
modern flight-control systems, models for the pilot m.ust be de- 
veloped which account for his decision-making as well as his con- 
trol behavior. If we wish to understand how the pilot performs a 
multiplicity of decision and control tasks, as he is often required 
to do, the models for decision behavior must be integrated into 
the models for monitoring and control. Ideally, a common m.odel 
structure would be developed to handle all the important tasks 
required of the pilot and to account for the mutual interference 
among these tasks that occurs because of the pilot's limited work- 
load capacity. 
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This report describes a study performed for NASA-Ames Research 
Center to develop a model for human decision-making that can ulti- 
mately be applied to decisions relating to aircraft management. 
Model development has been guided by the requirement to maintain 
a common model structure for both decision and control behavior. 
This work builds logically upon studies of multi- variable manual 
control systems performed under previous contracts with NASA-Ames. 

The model for decision-making developed in this study is in- 
tended to apply to situations in which the human bases his decision 
on his estimate of the state of a linear plant. It is based on 
the existing optimal-control model for pilot/vehicle systems de- 
veloped by Bolt Beranek and Newman Inc. The optimal-control 
model contains the concepts of observation noise, optimal predic- 
tion, and optimal estimation which can be directly applied to 
certain types of decision problems. In addition, the existing 
pilot/vehicle model is able to account for Interference among 
control tasks performed in parallel. Because the existing model 
structure appears particularly well-suited for encompassing both 
decision and control tasks, our efforts have been confined to re- 
fining this particular model structure and we have not searched 
for others which might explain the decision behavior observed in 
the experimental study. 

The report is organized as follows. In Chapter 2 we review 
existing models for decision-making and control that are relevant 
to this study. New model development is presented in Chapter 3 , 
along with a description and analysis of the decision task explored 
in this study. Principal experimental results are presented in 
Chapter ^ and discussed further in Chapter 5 . Concluding remarks 
appear in Chapter 6. The appendices contain supplemental informa- 
tion relating to the experimental and analytical procedures. 
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2. CURRENT MODELS FOR CONTROL AND DECISION-MAKING 


The model for human decision-making that is presented in this 
report builds logically upon existing models for human control and 
decision-making. The observation noise, optimal estimation, and 
optimal prediction concepts that appear in the optimal-control 
model for continuous tracking are key elements in the model for 
decision-making. In order that the reader may follow the model 
development presented in the next section of this report, we re- 
view below the most relevant features of existing models for human 
control and decision-making. 

2.1 Optimal Decision-Making' 

Models for optimal decision-making are summarized in detail 
in References 1 and 2. These models are based on the premise that 
well-trained humans decide in a near optimal manner. That is, 
decisions are made to maximize (or minimize) some performance 
measure. A number of performance measures may be postulated, and 
there has been some controversy in the literature as to which ones 
are appropriate to various decision situations (Ref.l). We shall 
consider here the class of decision-making tasks in which it is 
reasonable to assume that the human attempts to maximize the ex- 
pected "utility" of the outcome of his decision. 

Decisions are almost always based on less than perfect infor- 
mation about the present (or future) "state of the world". The 
state of the world may be one of any number of mutually exclusive 
possibilities; the human must determine the probability that each 
of the potential states is the true state. Two or more courses 
of action (i.e., "decisions") are possible, the correctness of 
any decision depending upon what happens to be the true state of 
the world. 



In order to model decision-making in the presence of uncer- 
tainty, we pretend that the human adopts the following decision 
strategy. First, he assigns numerical "utilities" to each of the 
possible outcomes of each decision. (For example, in deciding 
whether to land an aircraft or to abort, the pilot should weigh 
the benefit of making a successful landing, the cost of a crash, 
and the cost of making a go-around.) Typically, the utility of a 
correct decision is numerically positive, whereas that of an in- 
correct decision is negative. Having assigned utilities, the 
human then calculates the probabilities associated with each of 
the possible states of the world being true, using whatever rele- 
vant information he is able to obtain. He now computes the ex- 
pected utility associated with each decision and makes the deci- 
sion that yields the largest expected utility. Decision-making 
may thus be considered as a three-step procedure: (a) assignment 
of utilities to each state-decision combination, (b) assessment 
of the probabilities of the state of the world, and (c) taking 
the appropriate action. 

We shall consider the human's decision task as primarily that 
of determining the probabilities of the various states of the 
world. The utility matrix is assumed to be constructed prior to 
the task , and the action to be taken is automatic once the ex- 
pected utilities have been computed. 

We now formalize some of the concepts associated with the 
utility-maximization theory of human decision-making. Let the 
possible states of the world be represented by a set of mutually- 
exclusive hypotheses h^. One (and only one) of them represents 

■» 

Although it is a nontrivial task to determine the appropriate 
utility matrix in many realistic situations, the experimental 
tasks explored under this contract involved a utility matrix 
that was easily understood and accepted by the subjects. 
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the "true" state. The decision that the 1 hypothesis Is true 
is represented by The utility of deciding when, in fact, 

hj is true may be represented as U(H^,h^) or, more compactly, 

. We assume that the are numerically positive for i=J 
(the set of correct decisions) and negative otherwise. 

The human is presented some data [z] on which to base his 
decision. These data may be discrete items of information, con- 
tinuous waveforms, or combinations of both. In any case, we use 
[z] here to represent the entire past history of the data. The 
expected value of the utility associated with deciding is 

N 

E{U|Hi} = ‘ 

J=1 

where P(hjlz) is the probability that hypothesis h^ is true, given 
the available data. The optimal decision strategy is simply to 
select the hypothesis which maximizes the expected utility. 

Many important decision tasks require the human to decide be- 
tween two possible hypotheses (e.g., a contemplated landing either 
does or does not have a sufficiently high probability of success). 
The decision tasks to be studied under this Contract will fall 
into this class. Accordingly, we analyze the binary decision 
task in greater detail. 

Assume two mutually exclusive hypotheses h^ and h^. The ex- 
pected utilities of the possible decisions and Hq are given as 


E{UlH„) = 

• Pfho 

N> * Uoi 

• P(h^| 

|z) 

(2a) 

E(UlHj) . 

• P(ho 

|z) + 

• P(h;^i 

|z) 

(2b) 
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The decision rule is to decide if the expected utility asso- 
ciated with is greater than the expected utility associated 
with Hq; otherwise, decide Hq. Accordingly, we derive the fol- 
lowing decision rule from Equations (2a) and (2b): 

P(h,|z) U„ 

» - «i If ’ uf 

H = Hq otherwise 

where Uq = Uqq-U^^q and = ^ll“^01 * decision rule, then, 

may be based on the ratio of probabilities (the "odds ratio"), 
which, it seems, is more reliably estimated by humans than are 
the individual probabilities (Ref.l). 



Computation of the odds ratio is often facilitated by the 
use of Bayes' theorem, which may be stated as 

P(h,z) = P(h|z) • P(z) = P(z|h) • P(h) (4) 


where P(h,z) is the Joint probability of the event [h] and the 
data [z], and P(z) is the overall probability that event [h] will 
occur. P(h) is often called the "prior probability"; that is, 
the estimate of the probability that hypothesis [h] is true that 
is made before the data [z] have become available. Using Equa- 
tion (^), we may restate the decision rule to be 


?(z\h^) U. P(h.) 
^ " ^1 P(z|hQ) ^ * PTh^y 

H = Hq otherwise 


(5) 
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where the ratio P(zlh^)/P(z|hQ) is called the "likelihood ratio". 
The optimal (Bayesian) decision rule is usually expressed in this 
form. 


2.2 Models for Continuous Control 

2.2.1 The Optimal -Control Model for Pilot-Vehicle Systems 
The reader is assumed to be familiar with the optimal-control 
model that has been developed for analyzing pilot-vehicle systems. 
This model, which is described in detail in References 3 and , 
has been found capable of reproducing performance measures in a 
variety of single-variable and multi-variable tracking situations 
(Refs. 5-10). Most of the elements of the optimal-control model 
are contained in the model for human decision performance presented 
in the following chapter of this report. 

In order to refresh the reader’s memory, a block diagram of 
the model is shown in Figure 1. Let us review briefly those ele- 
ments which relate directly to human performance (shown within 
the dashed line). Human lim.itations are represented by a time 
delay ["r], by observation and m.otor noise processes, and, to some 
extent, by certain terms in the cost functional. The observation 
noise process v^(t) accounts for most of the stochastic portion of 
the human’s response (i.e., remnant); in some cases, a separate 
motor noise term v^(t) is needed to provide an accurate match to 
certain aspects of the controller’s behavior. A cost weighting 
on mean-squared control-rate activity is typically Included in the 
cost functional to represent limitations (both physiological and 
self-imposed) on the bandwidth of the controller’s response. The 
effect of this weighting is to generate a first-order lag with time 

constant x in the control strategy, 
n 
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HUMAN OPERATOR MODEL 




FIG. 1 THE OPTIMAL-CONTROL MODEL FOR PILOT-VEHICLE SYSTEMS 


- IH* 



The "adjustable" portion of the pilot's response strategy 
consists of: (a) a Kalman filter to provide the human with the 
best estimate of the system states; (b) an optimal predictor to 
compensate partially for the human's inherent time delay; and 
(c) an optimal control law, designated as -A* in Figure 1, which 
operates on the estimated state vector. These elements are pre- 
sumed to be structured by the human so as to minimize the cost 
functional within the limits Imposed by his inherent limitations. 

2.2.2 An Observation Noise Model for Controller Remnant 
Our model for controller remnant is reviewed in detail in Refer- 
ences 6-8. We originally developed a model for remnant based on 
multiplicative (i.e., proportional) sources of human randomness 
such as: (a) errors in observing the displayed variable, (b) errors 
in executing the Intended control action, and (c) random fluctua- 
tions in controller gain and time delay. Most of these processes 
were found to be indistinguishable in their effects on controller 
remnant and were therefore combined into a single noise process — 
an equivalent observation noise. 


Observation noise is most usefully represented as a vector 
process in which each sensory variable that is utilized by the 
controller is considered to be perturbed by a white noise process. 
These observation noise processes are assumed to be linearly in- 
dependent of each other and of external disturbance signals. 

When the rms airplltudes of the quantities presented on the display 
are large compared to visual threshold effects, the power density 
levels of the noise processes vary proportionally with signal 
variance (Ref. 8). In this situation, observation noise may be 
modelled as: 


V = 

-y 


P • 



( 6 ) 
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where V is a vector composed of the power density levels of the 
•/ 

component noise processes; P is a normalized noise level, or "noise/ 

2 

signal ratio"; and a is a vector composed of the variances of the 

«y 

quantities obtained from the display. This model for controller 
remnant has been verified by extensive analysis of single-axis 
manual control data. 

The numerical value of the noise/signal ratio, P, has been 
found to be on the order of 0.01 units of normalized power per 
rad/sec (i.e., -20 dB) for a wide variety of single-loop control 
tasks. The relative invariance of this measurement suggests that 
a central-processing type of disturbance common to all tracking 
tasks is primarily responsible for remnant that is measured under 
nearly ideal viewing conditions. Random perturbations of human 
controller gain or time delay are possible manifestations of 
central-processing "noise" that would account for the remnant 
that is measured. We have generalized upon the notion of central- 
processing noise to develop the model for task interference which 
is summarized below. 

2.2.3 A Model for Task Interference 
Because the human can exert only a limited amount of physical or 
mental effort, his performance on a given psychomotor task gener- 
ally degrades as he is required to perform more and more tasks 
simultaneously. Multiple tasks may thus be said to "interfere" 
with one another. Interference may occur in the visual system 
(because of scanning requirements), the motor system (if intermit- 
tent control becomes necessary), and the central-processing system 
(because of "sharing of attention"). 

A model for central sources of interference has been developed 
and is described in References 9 and 10. Development of this model 
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parallels the development of the model for controller remnant In 
that the various sources of Interference are reflected to an 
equivalent perceptual source of interference. For mathematical 
convenience, we treat Interference as occurring among the percep- 
tual subtasks that are embodied in the entire task environment. 


The model for Interference is based on the primary assumption 
that the controller has a fixed amount of "capacity" or "attention" 
which must be shared among the various tasks to be performed. The 
effects of capacity-sharing are modelled by the following equation: 


p(M) 

m 



( 7 ) 


where is the noise/signal ratio associated with the m^^ per- 

ceptual task when a total of M tasks are performed simultaneously, 
P is the noise ratio that is measured when a single task is per- 
formed, and f^^ is the fraction of capacity allocated to the m^ 
task. The nolse/slgnal ratio is thus shown to vary Inversely with 
the amount of "attention" devoted to a particular task. Since 
overall capacity or attention is presumed to be constant, the 
fractions of capacity must sum to unity. The noise/signal ratios 
associated with each of the subtasks must therefore obey the 
following rule : 

M M 

"c I ;kr- ^ 

m=l m=l m 

The human is assumed to distribute his attention, subject to the 
above constraint, to optimize some overall measure of performance. 
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This model for task interference has been validated in multi- 
variable continuous-control situations. The optimal control model 
described above has been used in conjunction with the model for 
interference to predict allocation of attention as well as track- 
ing performance in these situations. In the following chapter of 
this report we show how the model for task interference may be 
applied to multiple-decision tasks and to tasks requiring decision 
plus continuous control. 
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3. ANALYSIS OF THE DECISION TASK 


3.1 Introduction 

We imposed three constraints on the selection of an experi- 
mental decision task. The first constraint was that the task be 
compatible with the existing theoretical structure for optimal 
control and estimation. Secondly, we desired a task for which 
the correctness or incorrectness of the subject's response be 
unambiguous. Finally, a certain amount of resemblance between 
the experimental task and a decision task encountered in flight 
situations was desired. 

At the time we began this work, the state-variable model 
had been implemented only for task situations in which the inputs 
were continuous with time-stationary characteristics. Accordingly, 
we desired a task which required continuous observation and deci- 
sion-making (albeit discrete response activity.) The amount of 
pre-experimental model development and implementation would thereby 
be minimized, and predictions of decision performance could be 
obtained via Kalman estimation techniques then currently imple- 
mented on our digital computer. 

The requirement for unambiguous interpretation of the sub- 
ject's response was not a trivial one. Ambiguity does exist, for 
example, in the case of a continuous signal-detection (i.e., 
"vigilance") task. Here the subject is required to detect a ran- 
domly-occurring signal in the presence of continuous noise. Since 
the duration of the signal is usually very brief — on the order 
of the subject's reaction time — the subject's response will occur 
after the signal has ceased. Hence, it is not always clear 
whether a given response corresponds to the occurrence of a signal 



in the recent past or Is, In fact, a "false alarm" (Ref. 2). 

Partly for this reason, we decided against using a vigilance task. 

Our choice of a decision task was influenced to some extent 
by an investigation, concurrently perform.ed by NASA- Ames Research 
Center (Ref. 11) and Bolt Beranek and Newman Inc. (Ref. 12), of a 
pictorial runway display for making instrument approaches and 
touchdowns. This study Included an experiment in which the pilots 
were required, in effect, to determine whether or not they were 
within the "landing window". In order to relate the work of this 
project to the concurrent study of approach and landing, we de- 
signed and used a decision task that was an Idealization of the 
task of deciding whether or not the aircraft is in the landing 
window. This task is described below. 


3.2 Description of the Task 

The subject was presented with an oscilloscoplc representa- 
tion of a noisy glide-slope Indicator along with two reference 
indicators showing the "target", or region of acceptable glide- 
slope error. The subject's task was to keep his response button 
depressed whenever he thought the true error was within the target 
area. In order to test our model for task Interference, we pro- 
vided two such decision tasks simultaneously to the subject. In 
the two-task situation, two noisy indicators were presented on 
the same display and the subject manipulated two response buttons. 
The two "error" signals were linearly independent and were in no 
way affected by the subject's response. The display format for 
the two-task situation is shown in Figure 2. (Additional details 
on the experimental decision task are given in Appendix A.) 
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DISPLAY 

VARIABLE 

Y(t) 



TARGET 

REFERENCE 


FIG. 2 DISPLAY FORMAT 


Ill-IHM 




The quantity displayed to the pilot was constructed as the 
summation of a "signal" plus a "noise" waveform. Thus, 

y(t) = s(t) + n(t) (9) 

where y(t) was displayed to the subject, s(t) was a low-frequency 
random waveform that we defined as the "signal" (say, glide-slope 
error), and n(t) was a random waveform of higher frequency that 
we defined as "instrument noise". 


Both s(t) and n(t) were generated by Gaussian white noise 
processes which were shaped by filters of the following form: 


F(s) 


s 

s+0 .05 


1 + 


s ^ 





( 10 ) 


The element s/( s+0 . 05) was included to guarantee that each signal 

had zero mean; the second-order Butterworth filter provided the 

primary shaping of the signal. The "bandwidth" of s(t) was fixed 
* 

at 0.5 rad/sec , and the input amplitude was adjusted so that 
s(t) would be within the target area half the time during the 
course of an experimental trial. The bandwidth of n(t) was suf- 
ficiently greater than that of s(t) to enable the subject to dis- 
tinguish between the noise and signal components of the displayed 
variable [y(t)]. Noise power and bandwidth were experimental 
variables. The white noise forcing functions driving the signal 
and noise filters were linearly uncorrelated. 


For semantic convenience, we refer to the critical filter fre- 
quency as the "bandwidth" of the filter output. 
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Our mathematical description of this decision task consists , 
in part, of a state- variable representation of the dynamics of 
s(t)-, n(t), and y(t). Let x(t) be a vector consisting of the 
state variables needed to describe the problem. Since two third- 
order filters were used to generate the signal displayed to the 
human, the state vector must contain six elements, two of which 
may be identified with n(t) and s(t). The equations of motion 
of x(t) are 

x(t) = A x(t) + w(t) (11) 

where A is a matrix which accounts Jointly for the dynamics of 
these random processes and w(t) is a vector of the (two) Independent 
white driving noises. 

The subject was not shown the full state vector. Instead, 
he was displayed the summation of two of the states. The display 
vector was thus a linear transformation of the state vector and 
may be written in general terms as 

y(t) = C x(t) (12) 

(Since the subject will usually obtain rate as well as displace- 
ment information from his display, we must consider the subject’s 
perceptual input as a vector quantity even though only one quan- 
tity is displayed explicitly.) 

The mathematical representation of the decision task is thus 
to a large extent identical to our mathematical representation of 
the continuous control task. (See Ref.^) Not surprisingly, then, 
we may directly apply a considerable portion of our optimal-control 
model to the analysis of the decision task. The major difference 
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is that we replace optimal control action with optimal decision 
behavior. Our model for the human's decision strategy is described 
below. 

3.3 The Human's Optimal Decision Strategy 

It is convenient to separate the human's decision strategy 
into two distinct operations: (a) estimating the underlying signal 
s(t), given his perceptual Information, and (b) generating his 
decision response given his best estimate of s(t). The model for 
the human's estimation strategy is identical to that which we 
have applied in the continuous-control situation, as shown in 
Figure 3* The human's limitations are represented by an equivalent 
perceptual time delay and observation noise process, as before, 
and we retain the model elements of optimal prediction and Kalman 
filtering. The human is assumed to adopt an optimal decision rule 
which operates on his best estimate of the system states to yield 
a decision strategy which maximizes the expected utility of the 
decision. The optimal estimation and optimal decision aspects of 
the model are discussed separately below. 

3.3.1 Optimal Estimation 

The subject's ability to estimate the signal s(t) is limited not 
only by the addition of simulated instrument noise, but also by 
the subject's own internal noise and time delays. The time delay 
(or "reaction time") arises from a combination of neural conduc- 
tion times, central-processing delays, and limitations on neuro- 
muscular bandwidth. To the extent that the human cannot compen- 
sate for this time delay by an optimal prediction strategy, time 
delay will be a source of performance degradation. 






Second, and perhaps more important, is the randomness asso- 
ciated with human response behavior. That is, if v;e repeat the 
presentation of the entire waveform y(t) on tv;o different experi- 
mental trials, the subject will not depress and release his re- 
sponse button at exactly the same relative times from one trial 
to the next. V/ith respect to this particular decision task, 
potential sources of human randomness include: (a) perceptual 
errors made in observing y(t), (b) computational errors in esti- 
mating s(t) based on the perceptual input, and (c) variations in 
the human's effective time delay. For mathematical convenience, 
we combine all sources of randomness into an equivalent perceptual, 
or observation, noise process. This treatment of decision random- 
ness is parallel to our treatment of human controller remnant 
(see Refs . 6-8) . 

The human's perceptual input is thus considered as a noisy, 
delayed version of the quantity presented on the display and is 
represented as 

+ VyCt-T) (13) 

where Zp(t) is the vector of perceived quantities, t is the human's 
effective time delay, and v (t-T) is a vector of equivalent obser- 
vation noise process. (For the task considered here, the vector 
V contains tv:o components, v and v, to represent observation 

y y y 

noise processes associated v;ith estimation of displacement and 
velocity, respectively.) In keeping with our previous treatment 

of human observation noise, v;e consider v (t) to be composed of 

<y 

v^hite gaussian noise processes that are linearly independent of 
each other and of system forcing functions. 
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Since the displayed quantity is generated by linearly filtered 
white noise, the signal y(t) is, by definition, a sample function 
of a gauss-markov process (Ref. 13). This type of random process 
has the following properties which justify our assumptions of 
optimal estimation and prediction: 

1. The current "state” of the process contains all the useful 
information about the process. Thus, for most practical 
purposes, the entire past history of y^(t) is "summarized" by 
the current value of the state vector, x(t). 

2. The best estimate of the state vector is given by a Kalman 

filter cascaded with an optimal predictor which operates on 

the noisy input variable y.p(t) (Ref. 13). This filter is linear 

and time-invariant, and the difference between the instantaneous 

value of the state vector and the best estimate is also time 

Invariant. (This difference, or "estimation error", has a 

variance which we denote by a . ) The estimate of the state 

— 0 

vector, denoted by x(t), is "best" in the sense that it is 
the minimum-variance as well as the maximum- likelihood esti- 
mate. (Ref.l^) 

3. The pair (x(t),o ) constitutes a sufficient statistic to test 

hypotheses about x(t) based on the noisy data i^p(t). This is 

so because all the relevant information that can be extracted 

from y^(t) is contained jointly in x(t) and (Ref.l4). 

— — 0 

Note that the Kalman filter may be used to predict the vari- 
ance of the estimation error as well as the instantaneous best 
estimate of the state vector. (Predictions of the instantaneous 
estimation error cannot be obtained; otherwise, the state vector 
could be estimated perfectly.) In the following section we show 
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that knovj ledge of the rms estimation error is needed to generate 
the correct decision strategy. 

3.3.2 Optimal Decision Rule 

The general expression for the optimal decision rule has been 
derived in Chapter 2 as 


! P(h Iz) Uq 

PTh^-^ " 

( 1 ^) 

Hq otherwise 

v;here H(t) is the subject’s instantaneous decision response, h(t) 
is the state of the v;orld, z(t) represents the data upon which the 
human bases his decision, and Uq and relate to the utilities 
of the various correct and Incorrect decision possibilities. Let 
us identify h^^ as the condition for which the signal s(t) is v/ith- 
In the target boundaries (denoted by +Y^) . The condition h^ 
represents an outside-the-target condition. Similarly, and Hq 
represent the human’s decision that the signal is either inside 
or outside the target area. For the problem considered here, the 
data denoted by the general expression z(t) consist of the instan- 
taneous best estimate x(t) and the rms estimation error 
Although the Kalman filter yields the full x and o vectors, only 
those elements corresponding to the signal s(t) are needed for 
making the decision. 

We nov; reformulate the general decision rule of Equation (1^) 
in terms of problem variables: 
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if 


P( ls(t) l<Y;pjs(t) 

P( |s(t) |>Y^|s(t),ag ) 


H(t) = 


( 15 ) 


Hq otherwise 


For any U^/U^, we may find a "decision boundary" Y^ such that 


P( ls(t) |<Y^ 

t(t),C3 ) 
e 

P( jsCt) 1>Y^ 

§(t),a ) 

®e 




Thus, whatever the utility matrix, the subject’s optimal decision 
strategy is to respond "in" whenever his best estimate of s(t) is 
less than some predetermined decision boundary. 

The relation of the decision boundary to the actual target 
boundary depends on the ratio U^/Uq. For example, if the penalty 
for Incorrectly deciding that s(t) is on target is much greater 
than the penalties and rewards associated with the remaining de- 
cision possibilities (as might be the case in making a landing 
decision), the subject should set his decision boundaries to span 
a narrower range than the actual target boundaries. This strategy 
will cause him to make fewer errors of the expensive type at the 
cost of making more errors of the less costly type. If and Uq 
are equal (as presumably was the case in our experiments), the 
subject should adopt the actual target boundary as his decision 
boundary . 
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3.4 Predicted Decision Performance 


In this section we show how the model described above may be 
used to predict the sub,iect's decision error. Only the principal 
theoretical results are presented here; for more details on the 
computational procedure, see Section B.2 of the Appendix. Single- 
task and two-task situations are discussed separately. 

3.4.1 Single-Task Decision Performance 
We analyze here the single-task decision situations that were ex- 
plored experimentally. The principal performance measure is the 
"decision error", defined as the probability that the subject will 
make either type of decision error at any instant of time. That 
is. 

Decision Error = P(H^,hQ) + P(HQ,h^) (17) 

The subject is assumed to be penalized equally for either type of 
decision error. No reward is given for a correct decision. We 
shall, therefore, treat the decision error as a "cost" that is to 
be minimized (rather than a "utility", of negative numerical value, 
that is to be maximized). 

We consider two experimental variables: the critical freauency 
("bandwidth") of the filter used to generate the simulated instru- 
ment noise, and the ratio of "signal" power to "noise" power. In 
addition, we must select values for the human's time delay and 
observation noise levels. Let us fix the time delay at 0.2 sec. — 
a value that is typical of the effective delays inferred from 

n 

We interpret this probability as a prediction of the fraction of 
time that the subject's decision response will be in error over 
the course of an experimental trial. 
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studies of manual control behavior. Let us also assume that the 

observation noise levels are proportional to signal variance, and 

that the constant of proportionality P is the same for dlsplace- 

* 

ment and rate perception. This treatment is consistent with our 
treatment of controller remnant. 

Rather than specify a single, nominal value for the human's 
internal noise/signal ratio, we shall treat this model parameter 
as an analytical variable. We have two reasons for doing this. 
First, we intend to account for the effects of task interference 
through changes in noise/signal ratio. Accordingly, we must in- 
vestigate the relation between predicted decision error and noise/ 
signal ratio. Second, we require experimental evidence to ascer- 
tain the value of noise/signal ratio that corresponds to single- 
task performance (which, as we shall see, varies from subject-to- 
sub ject ) . 

Predicted decision error is shown as a function of noise/ 
signal ratio in Figure Curves are shown for each of the single- 

task conditions that were investigated experimentally. The filter 
bandwidth for the noise process n(t) and the ratio of signal power 
to noise power is given for each of the conditions in the legend 
accompanying the figure. 

For the most part, the curves shown in Figure ^ behave as one 

would expect. Predicted decision error increases as the simulated 

Instrument noise power increases and as the human's internal noise 

increases. There is one unexpected result, however. The rank 

2 2 

order of the two tasks corresponding to a o /a of 22 (Tasks B and 

s n 

C) depends on the noise/signal ratio parameter associated with the 

■jf 

A modification has to be made to the model of Equation (^) to 
account for the fact that the subject's display contains two 
reference levels (the two target boundaries) instead of the 
single zero reference that is usually presented. This modifica- 
tion is described in Section B.l of the Appendix. 
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DECISION ERROR 



FIG. 4 


EFFECT OF NOISE/SIGNAL RATIO ON PREDICTED DECISION ERROR 
Signal Bandwidth = 0.5 rad/sec 


27 


iiMiiiinimiiiiiiiii mil III I nil III llllliiiill ■l■Hlllllll■l■lllll■llllll■||||||| 


WHL - 121 





human. These two tasks differ with regard to the bandwidth asso- 
ciated with the noise process rad/sec for Task B, 8 rad/sec for 
Task C). For low levels of noise/signal, a lower score is asso- 
ciated with Task C. We would expect this to be the case, since 
the greater separation between signal and noise bandwidths for 
this task should allow the subject to distinguish signal from 
noise more accurately. The higher noise bandwidth associated with 
Task C, however, becomes a liability when the human's noise/signal 
ratio is relatively large, because the observation noise level as- 
sociated with velocity perception is proportional to the variance 
of indicator velocity. Thus, for high noise/signal levels, vel- 
ocity perception degrades more for Task C than for Task B, with 
the result that Task C now becomes the more difficult of the two. 

For a noise/signal ratio of -20 dB, predicted decision scores are 
essentially identical for Tasks B and C. 

The numerical value chosen for the human's time delay does 
not appear to affect the relationships among the four curves 
shown in Figure The relation between decision error and noise/ 
signal ratio is shown for three time delays in Figure 5 for the 
easiest and most difficult of the four decision tasks. As expected, 
an increase in time delay will yield a higher decision error for 
a given level of human noise/signal. The shape of the error-vs- 
noise/signal curve does not depend on time delay, however, and the 
effects of task parameters on decision error are unaffected by 
time delay. Thus, the same inerement in decision error is pre- 
dicted for a particular change in task parameters or for a change 
in noise/signal ratio from one specific level to the next when 
the time delay lies within the range of 0.1 to 0.3 second. 
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HUMAN'S NOISE /SIGNAL RATIO (dB) 


EFFECT OF TIME DELAY AND NOISE/SIGNAL RATIO ON PREDICTED 
DECISION ERROR SCORE 








The converse Is not true, however, when one attempts to infer 
an increment in observation noise level from a pair of decision 
error scores. For example, the pair of scores 0.10 and 0.15 rep- 
resents about a 9 dB increment in noise ratio for Task A when a 
time delay of 0.2 second is assumed, but only a 6.5 dB Increment 
when a 0.1 second delay is considered. If we intend to infer 
noise/signal ratios from experimental decision scores, then our 
interpretations could be appreciably in error if the subject's 
true delay were markedly different from the 0.2 second that we 
have assumed. We have, however, found average time delay to lie 
within a relatively narrow range about this value for the various 
manual control experiments that we have conducted. Accordingly, 
we do not expect to introduce appreciable modelling error by 
assuming an effective time delay of 0.2 second for the decision 
tasks . 

The foregoing analysis has been conducted on the assumption 
that the subject will select a decision boundary equal to the tar- 
get boundary; that is, he will hold the response button down when- 
ever he estimates the "signal" to be within the target. This 
would appear to be the optimal decision strategy for the situations 
we have investigated; namely, where the a priori probability of 
the signal being on target is 0.5 and the costs of either type of 
decision error are equal. It is nevertheless possible that the 
subject will adopt a utility matrix that differs somewhat from 
that assigned by the experimenter, in which case the decision 
boundary will not coincide with the target boundary. This is 
especially likely if the total decision error is relatively in- 
sensitive to the selection of a decision boundary. Accordingly, 
we have analyzed the easiest and m.ost difficult of the experimental 
decision tasks to determine the relation between decision error 
and decision boundary. 
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Let be the probability of a "false alarm"; l.e., 
joint probability that the signal will be outside the target area 
and that the subject will respond otherwise. Conversely, let DEq 
be the probability of a "miss"; i.e., the fraction of time that 
the subject falls to respond properly when the signal is on target. 
The total decision error is defined as the probability of either 
type of decision error and is simply DEq+DE^. For the situation 
in which equal costs are assigned to the two types of decision 
error, the overall performance measure is identical to the total 
decision error. 

In Figure 6 we show the effects of the decision boundary on 
the component and total decision error scores for Tasks A and D. 

The Independent variable shown on the abscissa is the decision 
boundary Y^, normalized with respect to the target boundary Y^. 

The decision area is assumed to be symmetric about zero: i.e., 
the subject indicates a "hit" whenever he estimates the signal to 
be within the limits of -Yj^ and +Yj^. 

For Task D we find that total error remains within 10 percent 
of the optimal error score for decision boundaries that range from 
20 percent below to 20 percent above the target boundary. The 
component error scores, however, change markedly with a shift in 
the decision criterion. For Y^/Y^ = 0.8, the predicted miss rate 
is about twice the false alarm rate. Conversely, for Yj^/Y^ = 1.2, 
the false alarm rate is about three times the miss rate. Decision 
performance for Task A is somewhat more sensitive to decision cri- 
terion in that a ten percent deviation in the decision boundary 
has the same effect on total error score. The relative magnitudes 
of the component scores show the same trend as is observed for 
Task D. In summary, we see that the subject may effect a consid- 
erable trade-off between false-alarm and miss rates without 
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TASK D 








seriously affecting his total score. In this sense, overall de- 
cision performance is relatively insensitive to decision criterion. 

3.4.2 Multiple-Task Performance 

It has been amply demonstrated that the human's performance on a 
given task generally degrades when a multiplicity of tasks are 
performed concurrently. We have shown this to be true for certain 
manual control situations, and we have developed and validated a 
model to account for the effects of task interference in multi- 
variable continuous-control situations (Refs. 9 and 10). This 
model may be applied in a straightforward manner to predict per- 
formance on multiple-decision tasks. 

Task interference is assumed to manifest itself as an increase 
in the human's internal noise/signal ratio according to the fol- 
lowing relationship 

Pi = P^fi (18) 

where P is the noise/signal ratio that corresponds to single-task 
o t h 

performance, is the ratio associated with the 1^ subtask in a 

multi-task situation, and f^ is the fraction of attention devoted 

to that subtask. This relationship may be used in conjunction 

with the curves shown in Figure 4 to predict multi-task decision 

performance as follows. 

Let us assume we first perform a calibration experiment in 
which we measure performance on a single decision task. The ap- 
propriate theoretical curve is used to determine the noise/signal 
ratio P^ that corresponds to this level of performance. If we 
know how much attention the subject will devote to the decision 
task in the multi-task situation, we increment the noise/signal 
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ratio by the amount Indicated in Equation (18) and refer again to 
the appropriate theoretical curve to predict the multi-task score. 
If we do not know a priori how the subject will allocate his at- 
tention, we obtain curves of performance versus attention for each 
component task and use these to determine the allocation of atten- 
tion which minimizes some measure of total-task performance. 


To illustrate this procedure, let us analyze the situation 
in which the subject is required to perform Tasks A and D simul- 
taneously. The performance index to be minimized is the combined 
decision error, which is defined as the summation of the total 
decision error scores for the two component tasks. We assume that 
the subject has a relatively fixed information-processing capacity 
which he applies fully to his decision task, however complex or 
simple that task may be. In other words, his fractions of atten- 
tion must sum to unity over the component tasks. Thus, if the 
subject devotes the fraction f^ to Task A in the two-task situa- 
tion, he will devote the fraction f^ = to Task D. The noise/ 

signal ratios associated with the two tasks will be : 


■’a Po^^'a 


■"d ' V'^-^a) 


(19) 


Using these relationships, along with the theoretical curves re- 
lating decision score to noise/signal ratio, we can compute com- 
ponent and total decision scores as a function of attentional 
allocation. The predicted (optimal) division of attention is the 
one which corresponds to the minimum total performance score. 
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Predicted component and total decision error scores are shov;n 
in Figure 7 as a function of the fraction of attention devoted to 
Task A. (A noise/signal ratio of -20 dB is associated with full 
attention.) We note that the component decision error scores are 
relatively insensitive to lack of attention and that an increase 
in one of the component scores is, to som.e extent, compensated for 
by a decrease in the other component score as the allocation of 
attention changes. Consequently, the combined decision error 
score is extremely insensitive to the subject's division of atten- 
tion. This score remains within 10 percent of its minimum value 
as the subject’s attention ranges from 80 percent on Task A to 
80 percent on Task D. Previous analysis of multi-axis tracking 
tasks with stable dynamics has also indicated a relative insensi- 
tivity of total-task performance to division of attention. (See 
References 9 and 10 . ) 

Because of the insensitivity of total-task performance to 
attention, we cannot expect to validate our method for predicting 
division of attention using decision tasks of the type v;e have 
been investigating. We can, however, test the accuracy of the 
model to predict the effects of interference on the total perform.- 
ance score. For example, in the absence of interference, the com- 
bined scores for Tasks A and D would be about 10 percent less than 
the optimal score predicted in Figure 7* Since performance on 
Task A is the most sensitive to noise/signal ratio of all the de- 
cision tasks considered in this study, a larger fractional in- 
crease in total score vjould be expected if two tasks of type A 
were performed simultaneously. The subject v/ould presumably de- 
vote 50 percent of his attention to each component task on the 
average, and the decision error score for either task vjould in- 
crease by about 17 percent. This latter situation has been in- 
vestigated experimentally, and in Section k .2 of this report v^e 
shov; that theoretical and experimental results are in good 
agreement. 
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The analysis procedure described above may also be employed 
to predict human performance when a decision task is performed 
concurrently with a continuous control task. In this case, the 
theoretical relation betv/een some measure of tracking performance 
(say, mean-squared error) and the human's noise/signal ratio is 
used, along with the corresponding curve for decision performance. 
VJe again find the division of attention that corresponds to mini- 
mum total score, where the "total score" might be specified as a 
v;eighted sum of decision error plus mean-squared tracking error. 

Since continuous tracking tasks differ from decision tasks 
in many respects, it is not obvious that the same noise/signal 
ratio should be associated with "full attention" for both 
tasks. We have seen that the ratio corresponding to single-task 
performance may depend on the sensitivity of performance score 
to noise/signal ratio (Ref. 9). In general, this sensitivity is 
greater for most laboratory tracking tasks than for the decision 
tasks considered here. Furthermore, we vfould expect the subject's 
noise/signal ratio to depend on how well the subject had learned 
the task. This is especially true for the decision task, where 
the noise/signal ratio must be inferred from the decision error 
score . 


Accordingly, v;e shall add an additional degree of freedom to 
the model for task interference when the tasks are qualitatively 
different from one another. For the situation in vrhich concurrent 
performance of a single decision and a single tracking task is to 
be analyzed, the model of Equation (19) is revised as follows: 






( 20 ) 
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where the subscripts T and D refer to tracking and decision per- 
formance, respectively. Experimental results on combined tracking 
and decision performance are presented in Section 4.3. 

3.5 Model -Val idation Procedures 

The model for the optimal decision-maker described above can 
be used to predict the fine structure of the human's decision 
strategy as well as to predict overall decision performance. For 
example, one can obtain a predicted describing function which 
represents the subject's optimal estimation strategy: l.e., the 
linear transfer between the displayed variable y(t) and the best 
estimate of the signal, s(t). In addition, one can Investigate 
the "remnant" portion of the decision strategy, which is simply 
the spectrum of the estimation error s^(t). 

Precise measures of these frequency-domain descriptors cannot 
be extracted from the experimental data, however. Unlike the task 
of continuous control, the decision task does not require the 
subject to respond in a manner that is linearly related to s(t). 
Thus, we can test the model only with respect to its ability to 
predict decision error scores. 

A variety of experimental conditions is reouired to test the 
predictive accuracy of the model. This is so because the model 
contains two "free" parameters relating to human limitations (ef- 
fective time delay and noise/signal ratio). Either of these pa- 
rameters could be adjusted to match the subject's decision per- 
formance under any given condition. Thus, we must explore the 
model's ability to predict differences in decision performance 
that arise from variations in the parameters of the task. Ideally, 
we would hope to find that performance differences of this type 
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could be accounted for with fixed values for time delay and for 
single-task noise/signal ratio. 

The same model-validation technioue applies to the tracking 
task in the combined tracking and decision task. That is, we 
determ.ine the extent to which tracking performance alone and 
tracking performance in the tv;o-task situation can be matched by 
a consistent set of model parameters. 


^ 

Because the hardware v/as not available for linking to BBN’s 
digital computer, v;e v/ere not able to analyze pilot describ- 
ing functions and remnant spectra as v/e have usually done in 
the past. Consequently, model-matching was performed by se- 
lecting noise/signal ratios and subjective cost functionals 
to match the available performance scores (m.ean-souared track- 
ing error, error rate, and control displacement). Time delay 
v;as held fixed at 0.17 second and motor noise at about -25 dE — 
values that have been found to be typical of K/s tracking. 

We do not feel that the validity of our analysis has suffered 
appreciably from the lack of frequency-domain m.easures . We 
have analyzed K/s tracking performance many tim.es in the past, 
and we have found that model param.eters which closely match 
the performance scores will usually reproduce accurately the 
describing functions and remnant spectra. (See References 4-10.) 
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4. THE EXPERIMENTAL PROGRAM 

An experimental program was undertaken to test the validity 
of the model for decision-making presented in the preceding chapter 
and to provide additional tests of our model for task Interference. 
The following situations were explored: (a) single decision tasks, 
(b) multiple decision tasks, and (c) simultaneous control and 
decision-making. The principal results of these experiments are 
presented in this chapter. 

Because of certain methodological problems associated with 
the particular decision task used in this study, not all of the 
experimental results provided a conclusive test of the model. 

This v/as particularly true for the experiment on simultaneous 
decision and tracking. These and other factors relating to dis- 
crepancies between theory and experiment are explored in some 
detail in the discussion of results given in Chapter 5. 

4.1 Effect of Task Parameters on Decision Error 

An experiment was conducted to determine the effect of changes 
in task parameters on decision error and on Inferred noise/signal 
ratio. Our primary objective was to test the predictive capability 
of our model. Specifically, we wished to determine the extent to 
which decision performance could be predicted by a model with 
fixed values for the human’s time delay and noise/signal ratio. 

4.1.1 Experimental Procedures 

Pour subjects were provided with six training trials on each of 
the four decision tasks described in Section 3.2. Experimental 
conditions are summarized in Table 1. Following training, three 
"data" trials were conducted with the right-hand and left-hand 
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displays active. Subjects responded to only one signal during a 
given trial, v;ith the remaining signal clamped at zero displace- 
ment. Additional details on subject training are given in 
Appendix A. 


TABLE 1 

EXPERIMENTAL CONDITIONS FOR SINGLE-TASK DECISION EXPERIMENT 


Task 

a^/o^ 
s n 

JLU l/li KJJ. 

n(t ) (rad/sec) 

A 

55 

8 

B 

22 

1} 

C 

22 

8 

D 

5.5 

8 


Bandwidth of s(t) = 0.5 rad/sec 

The average decision error score served as the primary per- 
formance measure. The "decision error" was defined as the frac- 
tion of run time during which the subject vjas not indicating the 
true state of the signal s(t). This score v/as computed as the sum 
of two component error scores: the "false alarm" rate (the frac- 
tion of time the subject decided that s(t) was inside the target 
when it was actually out) and the "miss" rate (the reverse type 
of decision error). 

The standard deviation of the total decision error score was 
estimated. This was defined as 



STD DEV 


( 21 ) 


N 


-.1/2 


^ (DE^-DE)^ 


1=1 


N(N-l) 


4" Vi 

where DE^ Is the average score of the 1^ subject for a particular 
task, DE Is the average score for all subjects on that task, and 
N Is the number of subjects (In this case, 4). A mean nolse/slgnal 
ratio was Inferred for each task by reference to the appropriate 
theoretical curve (Figures C-1 to C-4, Appendix C). Standard de- 
viations were estimated for the nolse/slgnal ratio as follov/s. 
Ratios were found which corresponded to the mean decision error 
plus (and minus) one standard deviation; the absolute value of the 
difference between these noise ratios, divided by two, was taken 
as the approximate standard deviation. 


4.1.2 Principal Results 

Figure 8 shows the effects of task parameters on predicted and 
measured average decision performance. Standard deviations for 
the measured scores are also shown. Predictions were obtained with 
nominal values of 0.2 sec and -20 dB assigned to the time delay 
and nolse/slgnal ratio parameters of the model. 


For the most part, predicted and measured scores were In very 
good agreement. For Tasks A, B, and C, the measured decision 
error score varied by less than one standard deviation from the 
theoretical prediction. The decrease In "Instrument noise" band- 
width from 8 to 4 rad/sec did not appreciably affect decision 
performance. (We had predicted that this would be the case If 
the human's nolse/slgnal ratio were -20 dB.) The only notable 
discrepancy between theory and experiment occurred for the most 
difficult task (Task D); In this case, the measured score was 
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0.10 


0.05 


TASK 

0-2 /0-2 
^ S n 

NOISE 
BANDWIDTH 
(rad /sec) 

A 

55 

8 

B 

22 

4 

C 

22 

8 

D 

5.5 

8 
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FIG. 8 EFFECT OF TASK PARAMETERS ON PREDICTED AND MEASURED 
DECISION ERROR 

4 Subjects, 3 Tri als/Sub ject 
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about 11 percent greater than the predicted decision error. A t- 
test performed on the subject means revealed that this difference, 
■while small in absolute terms, was significant at the 0.05 cri- 
terion level. 

Average scores for each subject are shown in Table 2. Also 
shown are the ratios of false alarm to miss rates, along with the 
noise/signal ratios inferred from the decision error scores. The 
false alarm rate was, on the average, about twice the miss rate 
for each of the four decision tasks. From Figure 6 we note that 
the false alarm rate should be about 50 % greater than the miss 
rate for minimum total score. Furthermore, total score is shown 
to be relatively Insensitive to a moderate trade-off between the 
false alarm rate and the miss rate. Thus, it would appear that 
the subjects adopted decision criteria that were appropriate to 
the tasks. 

Decision error versus inferred noise/signal ratio is shown 
graphically for Tasks A, C, and D in Figure 9. Rectangular boxes 
about each datum point Indicate +1 standard deviation of both the 
error score and the noise/signal ratio. (The results of Task B are 
not shown in this figure since they almost coincide with the re- 
sults of Task C.) The theoretical curves of Figure A are superim- 
posed on the experimental results. 

Figure 9 shows that the noise/signal ratio increases almost 
linearly with decision performance, ranging from -20.0 dB for 
Task A to -15.6 dB for Task D. Since the ratios Inferred for 
Tasks A, B, and C lie within one standard deviation of one another, 
we cannot ascribe any statistical significance to these differences. 
The noise/signal ratios associated with Tasks A and D, however, 
differ by about two standard deviations; this difference is too 
large to dismiss simply as experimental variability. 

Overall, we conclude on the basis of this experiment that the 
model for decision-making described in this report has good predic- 
tive capability with respect to the class of decision tasks explored. 
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TABLE 2 


EFFECT OF TASK PARAMETERS ON DECISION 
ERROR AND INFERRED NOISE/SIGNAL RATIO 


Subject 

Task A 

Task B 

Task C 

Task D 


E 

)eclslon Erro 

r 


DB 

.142 

.148 

.172 

.225 

MH 

.114 

.123 

.125 

.212 

WK 

. 108 

.168 

.151 

.199 

DM 

.090 

.126 

.137 

■ .193 

Mean 

.114 

.141 

.146 

.207 

Std. Dev. 

.0108 

.0105 

.0101 

.0071 

Ratio: (False Alarm Rate)/(Mlss Rate) 

DB 

3.9 

3.1 

2.1 

3.2 

MH 

1.7 

1.5 

1.8 

1.3 

WK 

2.2 

1.8 

2.4 

2.2 

DM 

1.6 

1.6 

2.2 

1.9 

Mean 

2.2 

1.9 

2.1 

2.0 


Inferred Noise/Signal 

Ratio (dB) 


Mean 

o 

• 

o 

CM 

1 

-19.0 

- 18.6 

-15.6 

Std. Dev. 

2.5 

2.5 

1.7 

2.2 


Average of 3 trials/subject. 


human's noise 


FIG. 


DECISION ERROR SCORES / 
FOR THREE TASKS 


4 Subjects, 3 Trials/S 







Using fixed values for human time delay and noise/signal ratio, 
we have been able to predict decision scores to vjithin 11 percent 
or better. At the same time, we note that wide range of noise/ 
signal ratios is needed to match all decision scores perfectly. 
Factors which contribute to this latter result are discussed in 
Chapter 5. 


4.2 Multiple Decision Tasks 


This experiment was performed to validate our model for task 
Interference in a decision-making context. Decision error scores 
were obtained for tasks performed singly and two at a time, and 
the difference betv;een the . 2-task and 1-task scores was tested 
against the difference predicted by the m.odel. 

4.2.1 Experimental Procedures 

The subjects were provided with two decision tasks of the type 
identified as Task A in Table 1. The statistics of the left- 
and right-hand tasks v/ere nominally identical, but the tv/o dis- 
play variables v;ere linearly uncorrelated. When two tasks v;ere 
performed concurrently, the subjects v;ere instructed to minimize 
the sum of the decision errors associated with each component 
task. The same four subjects v/ho participated in the single-task 
experiment were used in this study. 


After having been trained to an apparent asymptotic level of 
performance on the tv/o-task situation, each subject performed 
four data sessions. Each session consisted of three trials: 


V/e originally had Intended to vary the relative difficulty of 
the left- and right-hand tasks in an attempt to manipulate the 
subjects* division of attention. Pre-experim.ental model analysis 
revealed, hov/ever, that overall decision performance v/ould be 
relatively insensitive to attention, even when the component de- 
cision tasks differed considerably. (See the analysis presented 
in Section 3.4.2.) Hence, we decided against using task diffi- 
culty as an experimental variable. 
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(a) a single task for the left hand, (b) a single task for the 
right hand, and (c) left- and right-hand tasks together. 

4.2.2 Principal Results 

Average decision error scores are shown in Table 3 for each sub- 
ject for each task condition. Also shown are the scores averaged 
over the left and right tasks along with the average differences 
between 2-task and 1-task scores. Average decision error increased 
from 0.110 to 0.130 — an increase of about l6% — as the second 
task was added. A t-test showed this difference to be significant 
at the 0.001 level. 


TABLE 3 

EFFECT OF NUMBER OF TASKS ON DECISION ERROR 
INFERRED NOISE/SIGNAL RATIO 



Left Task 

Right Task 

Left 

Average 

and Right Tasks 

Subject 

1-Task 2-Task 

1-Task 2-Task 

1-Task 

2-Task 

Difference 


Decision Error 


DB 

.134 

.160 

.124 

.137 

.130 

.148 

.018 

MH 

.112 

.131 

.096 

.114 

.104 

.122 

.018 

WK 

.115 

.138 

.104 

.123 

.109 

.131 

.021 

DM 

1 

CO 

a\ 

o 

• 

.117 

.094 

.118 

.096 

.118 

.022 

Average 

.115 

.136 

.104 

.123 

.110 

.130 

.020 

Std. Dev. 

.0074 

.0090 

.0068 

.0050 

.0072 

.0067 

.0010 


Average of 3 trials/subject 
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If our model for task interference Is valid in this decision 
context, then the observed increment in decision score (averaged 
across the two tasks) should correspond to a doubling of the sub- 
jects* noise/signal ratio (again, averaged across the tv/o tasks). 

In order to obtain a theoretical prediction for 2-task performance, 
vie m.ust refer to the theoretical curve of Figure C-1. From this 
curve vie associate a noise/signal ratio of -20.8 dB i^ith the aver- 
age 1-task score of 0.110. Taking this point as a reference, v;e 
derive the curve shown in Figure 10 which relates the predicted 
increment in decision error to increments in noise/signal ratio 
(alternatively, to decrements in "attention”). The curve shown 

in the figure, then, is a segment of the theoretical curve of 
Figure C-1. 

The increments in decision error and inferred noise/signal 
ratio that vie obtained experimentally are shown in Figure 10 for 
comparison v/ith the theoretical curve. The range of decision 
error and noise/signal ratio corresponding to +1 estimated stand- 
ard deviation are also indicated. The increase of 0.020 in deci- 
sion errors score that we measured corresponds to an increment of 
3.3 dB in the inferred noise/signal ratio. This increase is vfith- 
In one standard deviation of the 3 dB increment predicted by our 
model for task Interference. Similarly, the assumption of a 3 dB 
increment in noise/signal ratio leads to a predicted increase in 
error score of 0.018. A t-test of the average 2-task, 1-task dif- 
ference scores shows that this prediction is not significantly 
different from the measured increase of 0.020. On the basis of 
this very good agreement between theory and experiment, vie con- 
clude tentatively that our model for task interference is applic- 
able to the type of decision task explored in this study. 
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0.04 


0.02 


0 



1.0 0.5 0.25 

FRACTION OF ATTENTION 


0 3 6. 
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FIG. 10 EFFECT OF ATTENTION ON DECISION ERROR SCORE, TASK A 
4 Subjects, 3 Trials/Subject 
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4.3 Simultaneous Control and Decision-Making 


The experiment described above confirmed that the model for 
task Interference, which had been validated previously in multi- 
variable control situations, could also be applied successfully 
to multi-task decision situations. The third and final experiment 
was conducted to determine v/hether this same model would account 
for interference betvjeen a decision task and a continuous control 
task performed concurrently. 

4.3.1 Experimental Procedures 

The subjects v;ere presented with two tasks to be performed concur- 
rently: a decision task (Task A, as described previously), and a 
continuous manual control task. The latter v/as a compensatory 
K/s tracking task of the type used in previous studies. The dis- 
play form.at shown in Figure 2 was used, v/ith the decision variable 
displayed on the left and tracking error displayed on the right. 
Display /response compatibility was maintained. The primary track- 
ing performance measure was mean-squared tracking error; decision 
performance was measured in terms of decision error, as defined 
earlier in this chapter. 

A diagram of the tracking task is given in Figure 11. All 
gains in this diagram are given in terms of units that correspond 
to settings of analog, com.puter elements. Similarly, all mean- 
squared signal scores tabulated in this report are in terms of 
analog readings. Conversions factors are provided in Table 4 so 
that the reader may convert these scores to psychophysical units. 

The input forcing function was constructed of 13 sinusoids 
to resemble a first-order noise spectrum with a critical frequency 
at 2 rad/sec. (See Appendix A of Reference 9 for additional 
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I = INPUT FORCING FUNCTION 
E = SYSTEM ERROR 
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FIG. 11 DIAGRAM OF THE EXPERIMENTAL TRACKING TASK 

All gains given in analog-machine units 2 
Mean-squared input = .840 (analog units)^ 
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TABLE 


CONVERSION FACTORS FOR MEAN-SQUARED SIGNAL SCORES 


Score 

To Convert From 
Experimental Units, 
Multiply by 

To Obtain 


1.2 X 10^ 

2 

(millirad visual arc) 

4 

1.2 X 10^ 

(milllrad/sec visual 

e 


2 

arc) 


^.7 

2 

nev7tons 


details on the input.) In the absence of control activity, the 
input signal represented an rms velocity disturbance of approxi- 
mately 3*7 degrees/second of visual arc. The control gain v;as 
such that 1 nevjton of force Imparted a velocity of ^1.6 arc-degrees 
per second to the error signal. 

The subjects* Instructions v;ere to minimize decision error 

(DE) vjhen performing the decision task alone, to minimize mean- 

squared tracking error (o^) when performing the tracking task 

alone, and to minimize a weighted sum of decision error and mean- 

squared tracking error when performing the two tasks concurrently. 

The overall performance measure for the tv;o-task situation was 

2 

defined as J = + 3 * DE. The subjects v;ere not instructed as 

to hov; to apportion their total score among the component scores. 
Additional details on the training procedure may be found in 
Appendix A. Three of the subjects v:ho had participated in the 
previous experiments were not available for this experiment and 
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were replaced by three new subjects. The newcomers were famili- 
arized with the single-task decision situation, and all four sub- 
jects were trained to apparent asymptotic performance on the 
tracking task and on the combined decision-plus-tracking task. 
Data-taking consisted of at least three sessions of three trials 
each as described for the previous experiment. 

4.3.2 Principal Results 

Because sub ject-to-sub ject variability was quite high in this 
experiment, we have not averaged the performance scores across 
subjects. Instead, we examine the average performance of each 
subject separately. 

Performance measures are shown for each subject's decision 
error, tracking error, and total performance score in Fjgure 12. 
One-task and two-task performance m.easures are compared. The 
1-task total performance measure is defined as the sum of the mean- 
squared tracking error obtained when tracking was performed alone , 
plus three times the decision error that was obtained when the 
decision task was performed alone. This measure is the total 
score that we would predict for the 2-task situation if we were 
to assume no Interference. Means and standard deviations for all 
performance measures (including mean-squared error rate and con- 
trol force) are given in Table 5« 

All of the 2-task, 1-task differences are in the expected 
direction. That is, each subject yielded higher performance 
scores in the 2-task situation than in the 1-task situation. 

This was true not only for the total performance measure but also 
for the component scores as well (including error-rate and con- 
trol scores). The magnitude of these differences, however, varied 
quite a bit from sub ject-to-sub ject . The fractional increase in 
total performance score ranged from about 5^ (subject WK) to about 
^5% (subject) WR) . The remaining two subjects (KC & HH) exhibited 
approximately a 15% increase in total score 
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FIG. 12 PERFORMANCE MEASURES FOR SIMULTANEOUS DECISION AND CONTROL 

^ Average of 4 Trials for Subjects KC, HH, WK 

^ Average of 3 Trials for Subject WR 
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TABLE 5 


AVERAGE PERFORMANCE SCORES FOR DECISION AND TRACKING 


Scope 

1 -Task 

Mean S . D . 

2 -Task 

Mean S.D. 



a) SUBJECT KC 


DE 

.Ill 

.003 

.123 

.008 

3 ‘DE 

.333 

.009 

.369 

.024 

C\J (D 

.150 

.006 

.186 

.003 

a? 

e 

5.25 

.192 

6.14 

.270 

a 2 

u 

.288 

.010 

.309 

.011 

3 -DE 

.483 

.026 

.555 

.009 



b) SUBJECT HH 


DE 

.125 

.004 

.143 

.007 

3 -DE 

.375 

.012 

.429 

.021 

e 

.178 

.006 

.202 

.005 

4 

5.14 

.336 

6.60 

.240 

< 

.284 

.014 

.336 

.087 

3 -DE 

.553 

.012 

.631 

.024 
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TABLE 5 (Cont.) 





d) SUBJECT WR 

DE 

.200 

.006 

.311 

3-DE 

.600 

.019 

.933 

“I 

.266 

.015 

.312 


5.30 

.096 

6.52 

0,2 

.267 

.008 

.=r 

C\J 

on 

• 

u 



3*DE 

.866 

.015 

1.25 


.026 

.078 

. 02^1 

.1|80 

.020 

.096 


SD = Estimated standard deviation of the mean 
Average of 4 trials/subject for subjects KC, HH, and WK 
Average of 3 trials for subject WR 

Tracking performance scores in analog-machine units 
All scores in experimental units 
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The data obtained from subjects WK and WR were considered 
unsuitable for providing a meaningful test of the model for task 
interference, and no further analysis was performed on these re- 
sults. WR’s results were omitted because of the atypical per- 
formance of this subject on the decision task. Figure 12a shov/s 
that his 2-task decision score was fully twice that of any other 
subject, and his 1-task decision score was appreciably larger 
than that shown by any of the other six subjects who participated 
in this experimental program. (His 1-task score of 0.20 corre- 
sponded to an unreasonably large noise/signal ratio about -11 dB.) 

The data from subject WK were also omitted from further con- 
sideration because of anomolous performance on the decision task. 

In particular, this subject's 1-task score was not self-consistent. 
Table 2 reveals that he achieved a decision error score of about 
0.11 on this task in the first experiment; this score rose to 0.1^ 
in this (the third) experiment, even with the benefit of additional 
practice on the 1-task decision situation. Thus, we do not know 
whether the very low level of task Interference revealed by this 
subject's performance is a meaningful result, or whether it indi- 
cates that the subject was not working to full capaci,ty when per- 
forming the decision task alone. The anomolous behavior of sub- 
jects WK and WR is discussed further in Chapter 5. 

The model for simultaneous tracking and decision performance 
was tested against the data obtained from subjects KC and HH. 

The first step in this procedure was to select model parameters 
to match the 1-task decision and tracking performance of each sub- 
ject. Decision performance was matched by using the curve of 
Figure C-1 to find the noise/signal ratios that corresponded to 
the decision error scores. Similarly, noise/signal ratios were 
chosen to provide perfect matches to the 1-task mean-squared 


58 



tracking error scores. Values for the time delay and motor noise 
parameters v;ere selected on the basis of previous manual control 
studies (Refs. 6-10), and a lag time constant was selected to 
match the 1-task error-rate and control scores to within 10 per- 
cent. Numerical values for these parameters are given in Figure 
13 . This figure also shows the theoretical relationship between 

the various tracking performance measures and the noise/signal 
* 

ratio. Superimposed on these curves are the average 1-task 
scores for subjects KC and HH. 

Table 6 shows the noise/signal ratios that were associated 
vjlth 1-task decision and tracking performance. These ratios vjere 
considered to represent "full attention", and theoretical curves 
of task performance versus attention were obtained according to 
the procedure described in Section 3* ^*2. All model parameters 
other than noise/signal ratio were held fixed for this analysis. 

TABLE 6 

MOISE/SIGNAL RATIOS CORRESPONDING TO "FULL ATTENTION" 


Task 

1 Subject 


KC 

HH 

Decision 

-20.6 

-18.2 

Tracking 

-22.8 

00 

• 

0 

CM 

1 


Figure l4 shov;s the predicted 2-task performance scores for 
combined decision and tracking for subjects KC and HH. Total 


■R 

The theoretical relation betvfeen mean-squared tracking error and 
noise/signal ratio is shovm on an expanded scale in Figure C-5 
of Appendix C. In this appendix we discuss more fully our selec- 
tion of values for model parameters . 
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PERFORMANCE SCORE (EXPERIMENTAL UNITS) 
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o SUBJECT KC 
□ SUBJECT HH 

MODEL PARAMETERS 
TIME DELAY = 0.17 SECONDS 
LAG TIME CONSTANT = 0.068 SECONDS 
MOTOR NOISE PD « -25 dB RELATIVE TO 
TO 0-2 



-24 -22 -20 -18 -16 -14 

NOISE /SIGNAL RATIO (dB) 


FIG. 13 EFFECT OF NOISE/SIGNAL RATIO ON PREDICTED TRACKING 
PERFORMANCE MEASURES 
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PERFORMANCE SCORE (EXPERIMENTAL UNITS) PERFORMANCE SCORE (EXPERIMENTAL UNITS) 



FRACTION OF ATTENTION TO THE TRACKING TASK 


FIG. 14 EFFECT OF DIVISION OF ATTENTION ON DECISION, TRACKING, 
AND TOTAL PERFORMANCE SCORES 
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performance, tracking error, and weighted decision error scores 
are shown as a function of the fraction of attention paid to the 
tracking task. From this figure we predict that each subject 
should devote about half his attention to each task for optimal 
performance. We note, however, that total performance is rela- 
tively insensitive to attention in the vicinity of this theoretical 
optimum. 

Superimposed on the theoretical curves in Figure l4 are the 
theoretical 2-task performance scores which correspond to no in- 
terference and to full interference. Also shown are the 2-task 
scores that v/ere obtained experimentally. The "no interference" 
theoretical scores are simply the scores obtained in the 1-task 
experiments. (The no-interference total score is the weighted 
sum of the 1-task tracking and decision error scores.) The "full 
interference" scores are the ones predicted by our model for task 
Interference. These scores are obtained from the theoretical 
curves of Figure 14 for a 50^ allocation of attention to the track- 
ing task (which is the allocation of attention that yields the 
lowest predicted total score). 

Both subjects achieved 2-task total scores that fell between 
the theoretical scores associated with no interference and with 
full interference. Thus, the mutual interference between the 
tracking and decision tasks was not as severe as was predicted by 
the model. Whether or not the measured 2-task scores differ sig- 
nificantly in a statistical sense from either of the theoretical 
scores is questionable. T-tests performed on the data from either 
subject alone do not reveal differences significant at the 0.05 
level. On the other hand, statistical significance is obtained 
if we pool the data of these two subjects (that is, if we treat 
the data as eight replications obtained from a single subject). 
T-tests then show that the average 2-task total performance score 
differs from the average no-interference score at the 0.01 level 
and from the average full-interference score at the 0.05 level. 
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Since v;e have reliable results from only t\ifo subjects, we 
cannot claim with a high degree of assurance that our model for 
interference either does or does not apply to the combined deci- 
sion and control situation. There appears little question that 
interference does occur: all four subjects yielded higher total 

and component scores in the 2-task situation. The degree of in- 
terference remains in question. Accordingly, v;e must conclude 
at this stage that the model which we have proposed for combined 
decision-making and control shov;s promise, and that a conclusive 
set of experiments remains to be conducted. 

We suspect that the inability to obtain reliable, conclusive 
data in this third experiment was due, in part, to the apparent 
insensitivity of the total performance score to attention. Note 
that v;e can predict the combined-task performance score to \uithin 
15 percent vjith either the full-interference or no-lnterference 
concept Incorporated into the model. In order to obtain a more 
conclusive set of results, a task should be explored vjhich is 
more sensitive to attention (l.e., more sensitive to the noise/ 
signal parameter of the model). The problem of insensitivity to 
noise/signal ratio is discussed m.ore fully in Chapter 5, and in 
Chapter 6 vje suggest an experiment which may largely avoid this 
particular drav/back. 
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5. DISCUSSION OF RESULTS 


Agreement between theory and experiment was quite good for 
the situations involving only decision-making tasks. Decision 
error scores were predicted to within an accuracy of about 10 
percent in both 1- and 2-task situations. Agreement was less 
good for the task of simultaneous decision-making and continuous 
control, with prediction errors on the order of 15 percent. 
Although the differences between predicted and measured perfor- 
mance scores were not large in an absolute sense, these dif- 
ferences cannot be entirely ascribed to "experimental variability. 

We suspect that certain methodological problems associated 
with the experimental decision task contributed to the discre- 
pancy between theory and experiment. These problems are 
discussed below. In the subsequent section of this chapter, 
we suggest two refinements to the model which might Improve 
the predictive accuracy of the model. 

5.1 Methodological Considerations 

In order for us to explore the limitations of human psycho- 
motor performance, we should, if possible, use an experimental 
task which is designed to motivate the subject to work to near- 
full capacity. Moreover, if the experimental results are to be 
meaningful, the task should be one for which the subject can 
readily learn the appropriate (l.e., optimal) response strategy. 
The particular decision task used in this study was somewhat 
deficient on both counts, as we shall show below. 



If it were possible to obtain a describing function and 
remnant spectrum for the human's decision strategy, we could 
assess the relative importance of the motivational and learning 
problems. In the sense that "motivation" is reflected by the 
degree to v^hlch the human suppresses his internal noise, an in- 
dication of motivation could be obtained by a linear transforma- 
tion of the remnant spectrum to an equivalent observation noise 
process. Comparison of theoretical and measured describing 
functions v;ould reveal the extent to v;hich the subject had 
learned the optimal strategy. Unfortunately, the intermittent 
nature of the subject's response precludes any such analysis; 
we can only speculate on the Importance of these factors. 

5.1.1 Insensitivity of Performance to Noise/Siqnal Ratio 
Perhaps the most serious drawback of the decision task which we 
explored — at least with respect to testing the model — was the 
relative insensitivity of decision error to the human's noise/ 
signal ratio. This insensitivity may be largely responsible for 
the v;lde range of noise/signal ratios needed to match all the 
single-task decision scores perfectly (Figure 9)» 

The human apparently attempts to suppress his Internal 
noise to a greater extent as the sensitivity of performance to 
noise/signal ratio increases. In a study of manual control 
performed under an earlier NASA-ARC contract, we found that our 
pilots achieved nolse/slgnal ratios on the order of -26 dB when 
tracking unstable second-order dynamics (Ref. 9). Earlier studies 
conducted with a variety of stable controlled- element dynamics 
had revealed noise/signal levels of about -20 dB (Refs. •4-8). 

Model analysis shov/ed that the sensitivity of mean-squared 
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tracking error to noise/signal was considerably greater for the 
unstable dynamics than for the stable dynamics. Thus, the sub- 
jects were apparently willing to operate at an unusually low 
level of Internal noise if the payoff was sufficient. Jex and 
Magdeleno have reported data which support this conclusion 
(Ref. 15). 

The theoretical curves of Figure ^ show that the sensitivity 
of decision error with respect to the human’s nolse/slgnal ratio 
decreases as the task difficulty increases. For a doubling of 
the noise/signal ratio from -20 dB to -17 dB, the decision error 
for Task A Increases about 17 percent, whereas an Increase of 
only about 5 percent is observed for Task D.* (The same Increase 
in noise/signal ratio corresponds to a 44 percent Increase in 
mean-squared error for the K/s tracking task used in this study.) 
Thus, it is entirely possible that the subjects were insufficiently 
motivated to maintain a -20 dB noise/signal ratio when performing 
Task D. 


Task-induced motivation may explain, in part, the tendency 
of the subjects to perform better than predicted in the combined 
decision and control task. One simple explanation of these re- 
sults is that the subjects "worked harder" in the 2-task 
situation in this particular experiment. As a measure of how 


*0ne would expect the sensitivity of decision error to the 
human's noise to decrease as the amount of simulated "instru- 
ment noise" is increased. Since the experimentally added 
noise was greatest for Task D, the proportion of total system 
noise attributable to the human was least. Thus, a given 
percentage increase in the human's noise reoresented a rela- 
tively lower percentage increase in total system noise for 
Task D than for the remaining decision tasks. 
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much harder the subjects worked, v/e can compute the amount of 
attention that the subjects devoted to each of the component 
tasks in the 2-task situation. Attention is defined as 

ATTN = p(l)/p(2) 

v;here and are the noise/signal ratios assoicated with 

the 1-task and 2-task performace measures, respectively. The 
noise/signal ratios, in turn, are derived from the error scores 
as described previously. 

Levels of attention associated with 2-task performance are 
shovm for subjects KC and HH in Table 7- The "total attention" 
levels given in this table are simply the summations of the 
attention levels associated with the component tasks. Also 
shovm in Table 7 are the decision error and tracking error 
scores, along with the inferred nolse/slgnal rations, for the 

1- and 2-task situations. Prom this table we observe that we 
can account for combined decision and tracking performance if 
we assume that subjects KC and HH Increased their "attentlonal 
capacities" by 21 percent and 33 percent, respectively in the 

2- task situation. 

Nov;, v;e have shovm that humans tend to lower their Internal 
noise levels (v;hich, v;e suggest, is equivalent to increasing 
the level of attention) as the sensitivity of performance to 
nolse/slgnal ratio Increases. Accordingly, let us compute the 
sensitivity of the total decision-plus-performance score vjith 
respect to noise/signal. In order to simplify the computation, 
v;e shall assume that a 50-percent division of attention between 
the tv;o component tasks allovm near-optimal performance. (See 
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TABLE 7 


PERFORMANCE SCORES AND INFERRED LEVELS 
OF ATTENTION FOR COMBINED DECISION AND CONTROL 


SUBJECT KC SUBJECT HH 


Task 

Variable 

1-task 

2-task 

1-task 

2-task 



.150 

.186 

.178 

.202 

Control 

P(dB) 

-22.8 

-20.5 

-20.8 

-19.6 


ATTN 

— 

.59 

— 

.76 


DE 

.Ill 

.123 

.125 

OO 

.=r 
1 — 1 

Decision 

P(dB) 

-20.6 

-18.5 

CM 

• 

oo 
1 — ) 

1 

-15.8 


ATTN 

— 

.62 

— 

.57 

Total 

ATTN 

— 

1.21 

— 

1.33 


the theoretical curves of Figure 1^.) Thus, a "full capacity" 
noise/signal ratio of -20 dB for the decision and tracking 
tasks performed separately Implies ratios of -17 dB each of 
the two tasks when performed concurrently. A doubling of the 
full-capacity noise/signal ratio is represented by -1^ dB on 
each task. Using the curves of Figures C-1 and C-5j we find 
that this increase in noise/signal ratio corresponds to an 
increase in total performace score of about 38 percent, where 
total performance is defined as the mean-squared tracking error 
plus three times the decision error. This fractional Increment 
in performance score is about twice that which we predicted 
above for the decision task alone. Thus, it is reasonable to 
expect that the subjects were more strongly motivated to reduce 
their internal noise levels when performing the combined task 
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(or v;hen performing a single tracking task) than v;hen performing 
a single decision task. 

5.1.2 Learning Difficulties 

The subjects may have encountered difficulty in learning the 
strategies appropriate to the various decision tasks because of 
inadequate knowledge of results during the training period. The 
only knov/ledge of performance given to the subject was the deci- 
sion error score that v;as told to him at the end of each training 
trial. Thus, if the subject were to try various strategies during 
the course of a single trial, he would not know which of the 
variations v;as best. 

The difficulty in providing the subject v;ith continuous 
feedback during the trial arises from the open-loop nature of the 
task. That is, the subject's response behavior has no Influence 
on the signal shovm on his display as it does, for example, when 
the subject is actually controlling the signal. Various methods 
of presenting relatively instantaneous knowledge of performance 
v;ere considered (such as illuminating a light whenever the sub- 
ject's response was Incorrect). These ideas were rejected, 
hov/ever, because of the high probability that the subject vfould 
learn to respond to the performance indicator and not to the 
signal on the primary display. To some extent, then, the re- 
latively large noise/signal ratio Inferred for decision Task D 
may reflect an inappropriate estimation strategy on the part of 
the subject. 

One of the subjects (WR) had a particularly severe learning 
problem. He did not lack for motivation; he appeared genuinely 
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concerned about the quality of his performance on the decision 
task. We attempted to improve his performance by providing de- 
tailed explanations of the task and of the appropriate strategy. 
Nevertheless, he was not able to bring his decision score down 
to a reasonable level, even with considerable practice. His 
tracking performance, on the other hand, was consistent with 
what we have seen in previous studies, so there is no reason to 
doubt that this subject possessed a reasonable amount of psycho- 
motor skill. (He was, in fact, qualified as a private flight 
Instructor and was the only subject participating in this study 
who had aircraft piloting experience.) Apparently, this subject 
was unable to learn the task effectively without continuous feed- 
back of performance. 

We do not have a good explanation for the oerformance of sub- 
ject WK on the decision task. His 1-task decision score was appre- 
ciably higher in the third experiment (combined decision and 
control) than it had been for the same task in the first and 
second experiments. Allowing for the possibility that the sub- 
ject had performed atyplcally on the day he performed the third 
experiment, we let him repeat this experiment. Before taking 
data a second time, however, we provided additional training to 
restore the subject’s skill on the decision task. Nevertheless, 
the second repljcatlon of the combined decision and control ex- 
periment gave the same results as the first; namely, an unexpec- 
tedly high 1-task decision score. It is as though the subject 
either "forgot” the appropriate decision strategy or lost his 
motivation to perform well on the decision task alone in this 
particular experimental situation. 
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5.2 Model Refinements 


5.2.1 Non-Constant Noise/Siqnal Ratio 

V/e expected prior to the first experiment that a noise/signal 
ratio of about -20 dB v/ould allow us to match the subjects' deci- 
sion performance for a variety of decision tasks. This assumption 
was based on our success at matching human controller behavior 
with this noise level for a number of control situations involving 
stable controlled-element dynamics. Such was not the case, how- 
ever, and we found an apparently linear relationship between the 
decision error and the logarithm of the noise/signal ratio* 

In keeping with the previous discussion of these results, 
we suggest that the model might be improved by taking the sensi- • 
tlvity of performance to nolse/slgnal ratio into account. That 
is, the rules for selecting observation noise levels might be 
modified to shov; the noise/signal ratio as an explicit function 
of this sensitivity. There is enough experimental evidence to 
indicate that this is a reasonable idea, although further study 
v;ould be needed in order to determine with any degree of preci- 
sion v;hat this function =hould be. A model refinement of this 
sort v;ould Improve the predictive accuracy of models for manual 
control as v;ell as for decision-making. 

5.2.2 Time-Varying Observation Noise Process 

In order to simplify the analysis of the decision task, we have 
treated observation noise as a time-stationary random process. 

This treatment is actually at variance v/lth our assumption of an 
underlying multiplicative noise process. (See the analysis of 
observation noise in Appendix B.) To be consistent, vie ought to 
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consider the power density level of the observation noise as a 
time-varying quantity which varies with the instantaneous magni- 
tude of the observed signal. 

The assumption of a time-stationary observation noise pro- 
cess has apparently worked very well for modelling human response 
behavior in continuous control situations. If one measures per- 
formance in terms of mean-squared tracking error, as we have 
done, then the effect of a given amount of estimation error on 
performance is independent of the instantaneous value of the 
tracking error. In this case, no loss of predictive accuracy 
results from consideration of average observation noise charac- 
teristics . 

The relation between observation noise and decision perfor- 
mance is more complicated, at least for the type of decision task 
we have studied. The effect that a given amount of estimation 
error has on decision performance depends very much on the rela- 
tion betv/een the magnitude of the estimation error and the 
instantaneous value of the "signal." For example, if the 
"signal" is two target widths beyond the target boundary, the 
subject will make the correct decision even if the instan- 
taneous error in his estimate of the signal position is substan- 
tial. On the other hand, relatively small estimation errors may 
cause an Incorrect decision if the signal is very close to one 
of the target boundaries. A more accurate modelling procedure 
would take account of the relation between Instantaneous signal 
value and the variance of the accompanying estimation error. 

It is possible that the subjects took advantage of the time- 
varying characteristics of the observation noise when performing 
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simultaneous decision and tracking tasks. For example, they 
could have shared attention betv/een the tasks when the decision 
signal was close to a target boundary and paid nearly full atten- 
tion to the tracking task at other times. Such a strategy might 
yield better performance than that predicted by a model in which 
the division of attention is assumed constant for the duration of 
a trial. On the other hand, one would also expect a time-varying 
strategy of this sort to Improve performance in the two-task 
decision situation. This apparently v;as not the case, however. 

The only v;ay to determine whether or not a time-varying 
observation noise process v;ould account for the discrepancies 
betv;een theory and experiment would be to incorporate this time- 
variation into the digital implementation of the model and per- 
form the required model analysis. This modification to the model 
v;as not made, because the effort Involved did not seem warranted 
in the context of this study.* Nevertheless, time-variations 
of this sort v/111 probably have to be included in the model if 
more realistic situations are to be analyzed, since most decision- 
making tasks are Intermittent, rather than continuous, in 
character. 


*Tlme variations of a different type have already been Incorporated 
into the pilot-vehicle model to allow analysis of the approach - 
to-landing problem. (Ref. 12). 
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6. CONCLUDING REMARKS 


A model for human decision-making has been developed and 
tested against experimental data. This model is a straightforward 
adaptation of the optimal-control model for pilot/vehicle systems 
developed previously by BBN. The "optimal gain matrix" included 
in the pilot/vehicle model is replaced by an "optimal decision 
rule" in the decision model. Otherwise, the two models are quite 
similar: both Include the concepts of time delay, observation 
noise, optimal prediction, and optimal estimation. The model for 
decision-making developed in this study is intended to apply to 
situations in which the human bases his decision on his estimate 
of the state of a linear plant. 

Three experiments were conducted, the first of which allowed 
us to determine the extent to which the model could predict the 
effects of changes in task parameters on decision performance. 

The remaining two experiments provided tests of our model for 
Interference in multiple-decision and in decision-plus-tracking 
situations. Experimental results agreed very closely with pre- 
dicted performance in situations involving only decision-making. 
Using fixed values for human time delay and noise/signal ratio, 
we were able to predict both 1-task and 2-task average scores to 
within an accuracy of about 10 percent. Agreement was less good 
for the simultaneous decision and control situation, with predic- 
tion errors on the order of 15 percent. Discrepancies between 
theory and experiment could not be attributed entirely to ex- 
perimental variability. Problems relating to the motivational 
aspects of the decision task and the difficulty in learning the 
optimal decision strategy were considered, along with suggestions 
for refining the model. 
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As we discovered after we had proceeded viell along in this 
study, the very nature of the decision task made it difficult to 
obtain conclusive results. Most importantly, decision performance 
v;as found to be relatively insensitive to the amount of attention 
paid to the task by the pilot. Accordingly, we recommend that 
future attempts to validate the model for decision-making devel- 
oped in this study be concerned v;ith tasks for ^uhich the human's 
overall decision performance is sensitive to the details of his 
response behavior. 

The pilot's task of deciding whether or not to land his air- 
craft is a decision problem to which the model may usefully be 
applied, and one which will allow a more critical test of the 
predictive accuracy of the model. Since the landing-decision 
task can be formulated as the task of deciding whether or not the 
aircraft is v/ithln the "landing window," this task falls within 
the class of those that can be handled by the model. Ideally, 
the model could be used to predict hov: changes in the nature of 
the information displayed to the pilot will help (or hinder) the 
pilot's decision-making ability. In addition, one could explore 
the effects of mutual interference between the decision task and 
the task of controlling the aircraft. 

The landing-decision task, even when simulated in the labora- 
tory, differs from the decision task explored in this study in 
some Important respects. First of all, a realistic landing- 
decision task is multi-dimensional. The pilot must not only 
determine v/hether or not the aircraft's altitude is within an 
acceptable range, but he must also check on the lateral position, 
rate-of-desent , and possibly airspeed and attitude as well. Be- 
cause of the complexity of the task, we suspect that decision 
performance vflll be reasonably sensitive to the pilot's Internal 
noise (particularly in the absence of simulated instrument noise). 
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The pilot will generally not have the "target boundaries" 
displayed to him. Instead, he must compare his perception of the 
state of the vehicle against some ideal state that is stored in 
his memory. An additional source of estimation error is now in- 
troduced into the problem to the extent that the pilot's mental 
image of the target area fluctuates with time. One might treat 
this problem by associating observation noise processes with the 
target boundaries as well as with the display variables related 
to flight control. Experimentation and analysis will be neces- 
sary to determine whether or not this is a valid approach, and, 
if so, what noise levels should be associated with the pilot’s 
mental image. 

If a single individual is controlling the aircraft and making 
the decision with regard to landing, one must consider the possi- 
bility of interference between the control and decision tasks. 
Because the same information obtained from the same displays is 
used for both tasks, the current model for interference may not 
be applicable to this situation without modification. (At pre- 
sent, interference is assumed to occur among perceptual variables 
and is accounted for by appropriate changes in the noise/signal 
ratios associated with each variable.) 

The model for decision-making might also be used to analyze 
the pilot’s task of detecting and identifying changes in control 
system dynamics. System dynamics will often degrade markedly 
whenever a system failure occurs, or whenever the "operating 
point" of the vehicle changes because, say, a stall is Imminent. 
The pilot must then identify the nature of the problem and adopt 
appropriate recovery strategy. The entire decision problem may 
be thought of as a four-step process: (a) detection of the change 
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In dynamics, (b) identification of the new dynamics, (c) modifica- 
tion of the pilot's basic control strategy, and (d) optimization, 
or "fine tuning" of the response. (See Reference 16 for a dis- 
cussion of adaptive manual control.) 

The model should be most readily applicable to the detection 
aspect of the problem. Elklnd and Miller (Ref. 17) have developed 
a model for the detection task in which the human is assumed to 
estimate the system states and to detect a change if these states 
exceed some pre-determined limits. There is thus a close analogy 
betvjeen this detection task and the decision task which has been 
described in this report. Note that we would have to include 
the pilot's optimal control strategy in the model for the de- 
tection problem in order to account for the fact that the pilot 
closes the control loop. 

V/e suspect that the model for decision and control could be 
applied to the identification phase of this decision problem if 
appropriate modifications were made to the model. This task is 
more complicated than the decision tasks we have considered up 
to nov/. It is no longer sufficient for the pilot to observe 
that system behavior is unusual; he must decide which set of 
events is most likely to account for this behavior. One v/ay to 
model the pilot's decision strategy is to assume that he con- 
structs a model of the system for each of the possible control 
system configurations that might occur. The pilot then compares 
the observed vehicle state with the outputs of each of the 
models and, using Bayesian decision rules, makes a guess as to 
how the system dynamics have changed (Ref. 17). In order to 
account for this decision strategy, the current model v;ould have 
to be augmented to represent additional "internal models" of the 
flight-control system. 
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In conclusion, we submit that the model for decision-making 
and control described in this study is worthy of further con- 
sideration. With some additional research needed to refine and 
extend the model, it should prove applicable to the analysis of 
important decision-making problems which face pilots in flight- 
control situations. In particular, the model should prove useful 
in indicating the extent to which changes in the control and dis- 
play systems will affect the pilot’s decision-making capability. 
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APPENDIX A 


EXPERIMENTAL APPARATUS AND PROCEDURES 
A.l Principal Experimental Hardware 
A. 1.1 Computing Machinery 

An Applied Dynamics AD/4 Analop-Hybrid System was used to simulate 
vehicle dynamics, filter input signals, generate the display, and 
compute the various performance measures. Input signals were ob- 
tained from pre-recorded analog magnetic tape. 

A. 1.2 Subject Booth 

Displays and controls were located in a subject booth that was 
isolated both acoustically and visually. A chin rest was provided 
to maintain a fixed eye-to-display distance. 

A. 1.3 Display 

The subject was provided with an oscllloscoplc presentation of 
the display shovm in Figure A-1. Eye-to-display distance v;as 
about 70 centimeters; thus, 1 cm. of display displacement cor- 
responded to approximately 35 mllliradians (2 degrees) visual 
arc. Target boundaries were generated electronically and v;ere 
located at +18 mllllrad (+1 degree) visual arc from the zero 
reference level. A zero reference indication was provided by 
a 0.l6 cm strip of opaque Red tape during the final experiment 
to facilitate manual control performance. No grid lines were 
shovm on the 'scope face. The phosphor of the display tube 
v;as type P-11, which gave a bluish cast to the reference and 
error indicators. 

A. 1.4 Controls 

A slngle-throv/ spring-return pushbutton allov;ed the subject to 
Indicate his instantaneous "decision." The pushbutton was mounted 
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so that It could be hand-held and thumb-operated. The subject 
v;as Instructed to keep the pushbutton depressed v/henever he thought 
the "signal" vvas within the target area; otherwise, he was to re- 
lease it. 

An aluminum stick attached to a force-sensitive hand control 
(Measurement Systems Hand Control, Model ^35) allowed the subject 
to control the tracking variable. The stick-control combination 
provided an omnidirectional spring restraint with a restoring 
force of about 28 nev;tons per centimeter deflection of the tip of 
the stick. The subject used wrist and finger motions to manipu- 
late the control stick and was provided with an armrest to support 
his forearm. The stick was mounted vertically; forward deflection 
of the stick imparted an upv;ard velocity to the tracking error 
signal that v/as proportional to the applied force. 

A. 2 Subjects and Training Procedures 

A. 2.1 Experimental Subjects 

Seven subjects participated in various phases of the experimental 
program. Six of these subjects were current or recent engineering 
students at Massachusetts Institute of Technology with no flight 
experience and no experience with laboratory tasks of the type 
explored in this study. The remaining subject v/as a former pri- 
vate flight instructor who had participated in previous studies 
of manual control. 

A. 2. 2 Run Length 

All training and data trials lasted four minutes and were gener- 
ally presented in sessions of tv;o or three trials each with a 
minimum rest period of about 10 minutes between sessions. Minimum 
rest periods of 1 minute were provided between successive trials 
vjlthln a session. 
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A, 2. 3 Inputs 

A number of Input signals were used in succession during training 
to minimize learning of the input . A separate set of four input 
segments were reserved for data-taklng. In order to minimize the 
effects of input differences on the experimental results, the 
same input segment was generally repeated for each of the three 
conditions investigated during a data session. 

A. 2.4 Training on the Decision Task 
The first training trial consisted of a run in which the subject 
simultaneously observed the "signal-plus-nolse" variable y(t) on 
one indicator and the "signal" s(t) on the other indicator. The 
object of this trial was to enable the subject to learn the sta- 
tistical properties of the "signal" and "noise" processes. For 
most of the subjects, a single trial of this sort was sufficient. 
Training then proceeded v/ith only the signal y(t) shovjn on the 
display, and the subject was informed of his "decision error" 
(defined below) at the end of each run. 

The subjects appeared to reach a stable level of performance 
after a few training trials. That is, the decision error score 
did not exhibit a consistent decrease with practice. Accordingly, 
when training the subjects for the first experiment, we provided 
them with an equal number of training trials per task; we did not 
attempt to train to an asymptotic level of performance as we would 
normally do for a tracking task. Six trials per task were provided. 

The subjects were trained to an apparently asymptotic level 
of performance prior to data-taking in the tv/o-task decision sit- 
uation. An average of 6 training trials on the two-task situation 
were conducted per subject. 


When performing a single decision task, the subjects were 
Instructed to minimize the total decision error (defined as the 
fraction of time during the run that their response v/as in error). 
This error score was computed as the sum of the tv;o component 
error scores: (a) the "false-alarm" rate, defined as the fraction 
of time that the subject responded "in" v/hen the signal was out- 
side the target, and (b) the "miss" rate, defined as the opposite 
type of decision error. The subject was not told specifically 
hov; to apportion his total decision error among the component 
scores, and he v;as generally not Informed of these component 
scores. If these tv/o scores differed by more than a factor of 
tv;o or three, hov/ever, the subject was informed of this and en- 
couraged to reduce the bias in his decision criterion. 

When performing two decision tasks concurrently, the subjects 
v;ere required to minimize a composite score defined as the sum of 
the total decision error scores on each task. At the end of each 
run, they vjere Informed of the composite score, plus the decision 
error associated with each task. They were not told how each de- 
cision error resolved into false-alarm and miss rates. 

A. 2. 5 Training on the Tracking Task 
Each subject v/as trained on the tracking task alone until an ap- 
parently stable performance level was reached. The instructions 
v;ere to minimize mean-squared tracking error. Approximately 30 
training trials vjere provided each subject. 

The subjects were then trained to an apparently asym.pt otic 
level of performance on the combined decision-plus-tracking task 
(about l4 trials per subject). The subjects v;ere instructed to 
minimize a v/eighted sum of tracking and decision errors. Before 
training was begun on the combined task, model analysis was 
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performed with nominal pilot parameters to determine a weiphtinp 
on the decision task that would allow the decision and trackinpr 
scores to contribute rouphly equally to the total performance 
measure. This weighting remained constant during the entire 
training and data-taking period. At the end of each session, the 
subject was informed of his total performance score, his tracking 
score, and his decision error score (both weighted and unweighted). 
The subject v;as not instructed as to how to apportion his total 
score among the component scores. 
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APPENDIX B 


ANALYSIS TECHNIQUES 

B.l Revised Model for Observation Noise 

The model for observation noise that we have used in the 
past is based on the assumption that pilot randomness arises from 
an underlying multiplicative noise process. We .iustify this as- 
sumption on the wealth of psychophysical evidence v/hich shows that 
the human's errors in estimating various quantities tend to scale 
with the magnitudes of these Quantities. In most of the tracking 
situations that we have explored in the past, the human's percep- 
tual task has been to estimate the magnitude of system error and 
error rate v/ith respect to a zero reference. For situations in 
v/hich the signals have had zero means, we have considered the 
power density level of the observation noise process to be propor- 
tional to signal variance. 

The perceptual task is somewhat different for the decision 
task that we have explored in this study. Here the subject's task 
is to determine v/hether or not the signal is on one side or the 
other of a target boundary — not hov; far it is fromi a null value. 
Thus, the reference level is nonzero, and our analysis should take 
this into account. 

In order to analyze the observation noise process in this task 
situation, let us start with our basic assumption of a multiplica- 
tive v;hlte noise process. V/e postulate the following model: 

Vy(t) = [y(t)-Y^l • m(t) (B-1) 
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where y(t) is the signal displayed to the human, is a reference 
level, m(t) is a white noise process which might be associated 
with noise in the human's central processing mechanism, and Vy(t) 
is the vjhite noise process that is effectively added to the dis- 
played variable. (We neglect the effects of visual resolution 
limitations, which would add another term to the model.) A sepa- 
rate and linearly independent noise process is associated with 
each of the perceptual variables to be estimated by the human. 

In general, the human will want to estimate the relative displace- 
ment and velocity of each display indicator. 

The autocorrelation of the noise process v (t) is defined as 
follows : 

♦ = £{Vy(t) • 

-Y^)(y(t+T)-Y^)m(t)-m(t+T)} (B-2) 

Since the multiplicative process m(t) is assumed to be linearly 

independent of the display variable y(t), the above expression 

may be written as a product of the autocorrelation of [y(t)-y^] 

times the autocorrelation of m(t). Since m(t) is a white noise 

process, its autocorrelation function is zero for all nonzero 

values of T, and it has a value of irP for t= 0, where P is the 

power density level of m(t) (defined over positive frequencies 
- * 

only). The above expression thus simplifies to 

4»y^(t,T) = £^|y(t )y(t+T)-Y^(y(t)+y(t+T) ) + Y^|--rrP 6(t) (B-3) 


The power density level P has been referred to in the text as 
the pilot's "noise/signal ratio." 
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This autocorrelation function has nonzero value only for 
T=0. Thus, v(t) is also a v/hite noise process whose pov/er density 
level is defined as 


Vy(t) = [4>^^(t,0)]/Tr 


(B-M 


Since the expected value of a sum of terms is equivalent to the 
sum of the expected values for each term, we obtain 


V^(t) 


= [f{y^(t)} - 2Y^.f{y(t)} + £{Y^} 


(B-5) 


The above expression shov/s the power density level of the 
observation noise process as a tlm.e-varying function. That is, 
the expected noise pov;er fluctuates v;ith the moment-to-moment dis- 
placement of y(t) from its reference value Y . In order to simplify 
our analysis, we shall henceforth consider the time-average value 
of the poise power, which v;e denote simply as This simplified 

representation of observation noise has been adequate to account 
for pilot remnant in a variety of steady-state control situations. 


For the particular decision task we have considered, analysis 
of the observation noise associated with indicator displacement 
is complicated by the presence of tv;o reference levels (+Y^ and 
-Yrp, the upper and lov;er target boundaries). We must make certain 
assumptions as to how the subject uses these reference levels in 
his estimation process. Let us assume that the subject's percep- 
tual task is to estimate the distance of the display variable y(t) 
from, the target boundary which is closest at any instant of time. 
(This makes perfectly good sense when y(t) is relatively close to 
one or the other target boundaries — the situation in which a 
decision error is most likely to occur.) Accordingly, the model 
of Equation (B-1) is modified as follows: 


89 



y(t) > 0 


Vy(t) = [y(t)-Y,j,] ♦ m(t) 

V (t) = [y(t)+Y^] • m(t) y(t)< 0 

o 


(B-6) 


The expression for the power density level V^(t) is modified in a 
similar manner. 


Let us compute the power density for the situation in which 
y(t) ^ 0. Equation (B-5) is written as 


V 


+ 


y 


00 oo 

|y^ p(y)dy - 2Y^ jy 
0 0 


CO 


p(y)dy + Y^ 


Jp(y)dy • 

0 


p 


(B-7) 


where p(y) is the probability density function of the display 

variable y(t). For the decision task we are considerinpc, y(t) is 

2 

a Gaussian random variable with zero mean and a variance d . 

1/ 

Accordingly, v/e obtain 

P (B-8) 

An identical expression is found for the noise associated with 
the time for which y(t) < 0. The total average noise pov;er is 
given as the sum of V and V~ and is approximately 

*/ tX 

Vy = [dy + Y^ - (1.6) Y^ • dy]P (B-9) 

This expression applies to the estimation of indicator displace- 
ment. Since the reference for estimating indicator velocity is 
simply zero velocity, the power density level for observation 
noise on velocity is 


v-^ = 
y 


-2Y^(.3989)d, 
2 o y 


III 

2 
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(B-10) 



P 


which is the model v/e have used successfully in the past. 


The expression of Equation (B-9) .may be written so as to 
indicate a "correction factor" to the simplified expression for 
observation noise. Thus, 


V 


a^-P-C 

y 


where 



( 1 . 6 ) ^ 
y 


(B-ll) 


(B-12) 


Correction factors appropriate to the four decision tasks investi- 
gated in this study are shovm in Table B-1. 

TABLE B-1 

CORRECTION FACTORS APPLIED TO THE PILOT’S NOISE/SIGNAL RATIO 


Configuration 




Correction 
Factor (dB) 

A 


.197 

1.^7 

-4.3 

B 

1.A6 

.311 

1.49 

-4.2 

C 

1A6 

.311 

1.49 

-4.2 

D 

l.i\6 

1 

.623 

1 

1.59 

-4.1 

1 
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B.2 Prediction of Decision Performance 


Descriptions of the experimental decision task and of the 
model for the human in this situation have been piven in Chapter 
3. In this section we elaborate on the analytical procedures for 
predicting decision performance. For convenience, the m.odel 
structure shown in Figure 3 is repeated in Figure B-1. 

B.2.1 Optimal Estimation 

The portion of the model relating to optimal estimation allows us 
to predict the variances of the subject's best estimate of each 
state variable and the variances of the corresponding estimation 
errors. The variances corresponding to the estimate of the 
"signal" s(t) and the error in estimating this signal Cs^(t)] are 
then used to compute the subject's decision error, as described 
below. This portion of the model is contained in our optimal- 
control model for pilot/vehicle analysis, which has been fully 
described in the literature. The reader is referred to References 
4 and 5 for further details. 

B.2. 2 Probability of Decision Error 
In order to have a theoretical prediction to test against the ex- 
perimental measure of decision performance, we m.ust identify the 
relative frequency of an error with the "pure probability of an 
error. Our experimental measure is, by necessity, a relative- 
frequency measure; that is, the decision error that we measure 
experimentally is defined as the fraction of time during a trial 
that the subject's response is incorrect. Our theoretical pre- 
diction, on the other hand, is the probability that, at any arbi- 
trary instant of time, a decision error will be made. 
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Let us represent the various "states of the world" and the 
human’s "decisions" by the followinp notation: 

h^ implies s(t) within target area 

hp implies s(t) outside target area 

implies a decision that s(t) is within target area 

Hq implies a decision that s(t) is outside target area 

Two types of decision error may be made. A "false alarm,’’ denoted 
by the condition (H^jh^), occurs whenever the subject indicates 
"in" when, in fact, the signal is actually outside the target area. 
The reverse type of decision error, or a "miss", is denoted as 
(HQ,h^). The total probability of a decision error is the sum of 
the probabilities of a false alarm and of a miss. Thus, 

P(DE) = P(H^,hQ) + P(Hp,h^) (B-13) 

We shall first com.pute the probability of a false alarm. 

Let +Y^ be the target boundaries, [s] be the location of the 
"signal" at any instant of time, [s] be the subject's best esti- 
mate of the signal, and Cs^] be the estimation error. By defini- 
tion. 


Sg = s - s (B-1^) 

We have already shown that the subject's strategy v/ill be to re- 
spond "in" v/henever his best estimate of the signal lies within 
his "decision boundary," denoted by +Yp (see section 3*3.2). The 
probability of a false alarm is thus 


9 ^ 


(B-15) 


P(H^,hQ) = P(Is[ 1 Yp , [s| > Y^) 

The above expression can be simplified somev/hat if we take 
advantage of the symmetry of the particular decision task that 
we have explored. Since the signal s(t) and the noise n(t) are 
each Gaussian random variables v/ith zero means, the probability 
of a decision error being made v;hen the signal is above the upper 
target boundary is equal to the probability of an error v/hen s(t) 
is below the lower boundary. Thus, the probability of a false 
alarm may be written as 


P(H^,hQ) = 2 • P(|s|<Yjj,s>Y^) 


(B-16) 


The computation of this probability is facilitated if it is 
re-stated in terms of [s] and [s^]. Using the definition of 
Equation (B-l^l), v/e derive the following identity: s>Y^ Implies 
that Sg<s-Y^. Equation (E-l6) may now be v/ritten as 

P(H^,hQ) = 2 • P(-Yp<s<Yp,Sg<s-Y^) 


+Yp s-Y^ (B-17) 

=2*1 I p(s,Sg) *ds^‘ds 

v;here p(s,s^) is the joint Gaussian probability density function 
for the signals s and s^. Since the optimal estimate and estima- 
tion error predicted by the Kalman filter are linearly independent 
(Refs. 13,1^), the joint probability density may be factored into 
the product of the Individual densities. -Thus, 


+Y 


D 


S-Yn 


P(H^,hp) = 2 • 


-Y 


I P(Se)-ds, 


p(s)-dS 


D 


(B-18) 
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yv 2 

The variables [s] and [s^] are Gaussian with variances Og 

and , respectively. Let us make the following change of 
®e 

variables : 


5 


s 

e 


y\ 


. S/U3 

■= Sg'''’ 


s 


e 


(B- 19 ) 


wh8r6 £ and £ ai*6 normalizad Gaussian variablas. The probability 
e 

of a false alarm may now be written as 




P(H^,h^) = 2 


i 






£3 

/ 






where p (E) is the unit-variance Gaussian probability density 
o 

function. 


The probability of a "miss" is computed in a similar manner. 
This probability may be written as 


P(HQ,h^) = P(|sl>Yj^,lsl<Y^) 


= 2 


= 2 


P ( s>Yp , s-Y^<Sg <s+Y^) 
s+Y„ 


/ 


D! 


J 

s-Y„ 


p(Se)dSg. 


« y\ 


p(s)*ds 


(B-21) 
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Making the change of variables shown in Equation (B-19), the 
probability for a miss may be written as 


P(HQ,h^) 


= 2 


f 






f 


Po'«e><*«e 


^s s T 


P (£ )d£ 
^o s 


(B-22) 


The total probability of a decision error, P(DE), is simply 
the sum of the probabilities shown in Equations (B-20) and (B-22). 
This number is a function of the target boundary Y,p, the decision 
level Yjj, and the variances of the subject's estimate of s(t) and 
of his estimation error. These variances are given by the portion 
of the model relating to optimal estimation. The target boundary, 
Y^, is an experimental parameter. The remaining parameter, Y^, 
is the decision level that is selected by the subject to minimize 
his total decision score P(DE). 

It may be possible to solve analytically for the decision 
level v/hich minimizes the decision score. Rather than attempt 
that, hov;ever, ^^^e have performed a numerical investigation of the 
relation between decision score and Yj^. For the condition in 
v/hlch s(t) is equally likely to be Inside or outside the target 
and decision errors of either type are weighted equally in the 
overall performance measure, the optimal decision boundary appears 
to coincide v/ith the target boundary. 
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APPENDIX C 


SUPPLEP>ENTAL THEORETICAL DATA 

This appendix contains five graphs which relate predicted 
system performance to noise/signal ratio. Figures C-1 through C-^ 
pertain to performance on the four decision tasks explored in the 
first experiment; Figure C-5 pertains to mean-squared tracking 
error. 

Values for the time delay and motor noise parameters of the 
model for the human controller were chosen on the basis of pre- 
vious studies of manual control. A time delay of 0.17 second v/as 
selected because it was found to be typical of effective time 
delays measured in K/s tracking tasks (Refs. 8 and 9). (The time 
delay of 0.2 second assumed for decision-making represents an 
average delay that is typical of a v/ider range of manual control 
situations.) A motor noise/signal ratio of -25 dB v;as found to 
be representative of single-loop tracking behavior (Ref. ^). 

Observation noise/signal ratios and effective lag time con- 
stants were selected to provide a good match to the mean-squared 
error, error rate, and control scores. The lag time constant of 
0.068 second that v/as needed to match the tracking performance of 
subjects KC and HH vias less than the time constants that we have 
generally found in previous experiments with K/s dynamics. (Time 
constants in the range of 0.08 to 0.1 are typical.) Since the 
subjects used in these experiments had no piloting experience, 
it is possible that they were less inhibited about making rapid 
control movements than vjere the subjects used in previous studies 
(v/ho, for the most part, were instrument-rated pilots). 
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APPENDIX D 


LIST OF SYMBOLS 

A Matrix of constants which represents system dynamics 

C Correction function for observation noise 

C Matrix of constants which relates display vector to state 

vector 

DE Decision error 

P(s) Filter characteristics 

f Fraction of attention 

H Subject's decision as to the state of the world 
h Assumed "state of the world" 

J Total performance score 

m Multiplicative noise process 

n "Noise" portion of signal-plus-noise variable displayed to 
the human 

P Human's nolse/slgnal ratio. Also, probability density function 

Noise/signal ratio pertinent to a single-task situation 

s The "signal" portion of the signal-plus-noise variable dis- 
played to the human. Also, the Laplace operator. 

s Human's best estimate of the "signal" 

Sg Error in estimation of the "signal" 

U Utility of a decision 

v^ Motor noise process 

V Equivalent (vector) observation noise process 
»y 

V Power density level of observation noise process 

•7 

w Vector of system forcing functions 

X Vector of state variables 
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<xl 


The human's best estimate of the state vector 
jr Vector of display variables 

^ Vector of display variables as perceived by the human 

Decision boundary adopted by human when performing decision 
task 

Y,p Target boundary used in decision task 

z Represents data base on which human bases his decision 

6 Impulse function 

0 )^ Critical frequency of a noise-shaping filter 

4) Autocorrelation function 

2 

a Signal variance 

T Human's effective time delay 

Lag time constant which appears in model for human controller 
C Normalized Gaussian variable 

-jl* Optimal gain matrix which appears in the model for the human 

controller 

Subscri pts 

D refers to decision boundary; also refers to decision task 

e refers to estimation error; also refers to tracking error 

T refers to target boundary; also refers to tracking task 
u refers to control signal 

X refers to system states 

y refers to display variables 

1 refers to "signal" within target area; also refers to single- 

task situation 

0 refers to "signal" outside target area 
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Superscri pts 


M refers to multiple-task situation 

1 refers to 1-task situation 

2 refers to 2-task situation 


NASA-Langley, 1971 5 
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